NASA/TP-1999-209545 



Uncertainty Analysis of Instrument 
Calibration and Application 

John S. Tripp and Ping Tcheng 

Langley Research Center , Hampton, Virginia 


October 1999 



The NASA STI Program Office ... in Profile 


Since its founding, NASA has been dedicated 
to the advancement of aeronautics and space 
science. The NASA Scientific and Technical 
Information (STI) Program Office plays a key 
part in helping NASA maintain this 
important role. 

The NASA STI Program Office is operated by 
Langley Research Center, the lead center for 
NASA's scientific and technical information. 
The NASA STI Program Office provides 
access to the NASA STI Database, the 
largest collection of aeronautical and space 
science STI in the world. The Program Office 
is also NASA's institutional mechanism for 
disseminating the results of its research and 
development activities. These results are 
published by NASA in the NASA STI Report 
Series, which includes the following report 
types: 

• TECHNICAL PUBLICATION. Reports of 
completed research or a major significant 
phase of research that present the results 
of NASA programs and include extensive 
data or theoretical analysis. Includes 
compilations of significant scientific and 
technical data and information deemed 

to be of continuing reference value. NASA 
counterpart or peer-reviewed formal 
professional papers, but having less 
stringent limitations on manuscript 
length and extent of graphic 
presentations. 

• TECHNICAL MEMORANDUM. 

Scientific and technical findings that are 
preliminary or of specialized interest, 
e.g., quick release reports, working 
papers, and bibliographies that contain 
minimal annotation. Does not contain 
extensive analysis. 

• CONTRACTOR REPORT. Scientific and 
technical findings by NASA-sponsored 
contractors and grantees. 


• CONFERENCE PUBLICATION. 

Collected papers from scientific and 
technical conferences, symposia, 
seminars, or other meetings sponsored or 
co-sponsored by NASA. 

• SPECIAL PUBLICATION. Scientific, 
technical, or historical information from 
NASA programs, projects, and missions, 
often concerned with subjects having 
substantial public interest. 

• TECHNICAL TRANSLATION. English- 
language translations of foreign scientific 
and technical material pertinent to 
NASA's mission. 

Specialized services that complement the 
STI Program Office's diverse offerings include 
creating custom thesauri, building customized 
databases, organizing and publishing 
research results . . . even providing videos. 

For more information about the NASA STI 
Program Office, see the following: 

• Access the NASA STI Program Home 
Page at http:llwxvw.sti.nasa.gov 

• Email your question via the Internet to 
help@sti.nasa.gov 

• Fax your question to the NASA STI 
Help Desk at (301) 621-0134 

• Telephone the NASA STI Help Desk at 
(301)621-0390 

• Write to: 

NASA STI Help Desk 

NASA Center for AeroSpace Information 

7121 Standard Drive 

Hanover, MD 21076-1320 



NASA/TP-1999-209545 



Uncertainty Analysis of Instrument 
Calibration and Application 

John S. Tripp and Ping Tcheng 

Langley Research Center, Hampton , Virginia 


National Aeronautics and 
Space Administration 

Langley Research Center 
Hampton, Virginia 23681-2199 


October 1999 



Available from: 


NASA Center for AeroSpace Information (CASI) 
7121 Standard Drive 
Hanover, MD 21076-1320 
(301) 621-0390 


National Technical Information Service (NTIS) 
5285 Port Royal Road 
Springfield, VA 22161-2171 
(703) 605-6000 



Contents 

Symbols 

1. Summary 

2. Introduction 

3. Instrument Modeling and Calibration Experimental Design 

3.1. Genera] Multivariate Process 


3.2. Single-Input Single-Output Process 1 

3.3. Linear, Polynomial, and Nonlinear Multivariate Processes 3 

3.4. Calibration Experimental Design 4 

4. Generalized Linear Multivariate Regression Analysis ; > 

4.1. Decorrelation of Covariance Matrix b 

4.2. Least-Squares Est i mation of Process Parameters b 

5. Confidence and Predict ion Intervals 7 

5. L Confidence Intervals of Estimated Parameters 7 

5.2. Calibration Confidence Intervals of Predicted Process Output 8 

5.3. Prediction Interval of New Measurement ^ 

G. Computation of Inferred Input With Confidence and Prediction Intervals 9 


7. Calibration Uncertainty Caused by Combined Input Errors and Measurement, Errors 

8. Effects of Process Modeling Error 

8.1. Uncertainty Analysis of Modeling Error 

8.2. Design Figure of Merit 

8.3. Effects of Experimental Design on Figure of Merit 


9. Uncertainty Analysis of Nonlinear Instrument Calibration 13 

9.1. Combined Input and Measurement Uncertainties 13 

9.2. Least-Squares Estimation of Process Parameters 15 

9.3. Uncertainty of Estimated Process Parameters 15 

9.4. Residual Sum of Squares and Standard Error of Regression 1G 

9.5. Confidence and Prediction Intervals of Predicted Output 17 

10. Multivariate Multiple-Output Analysis 19 

11. Uncertainties of Inferred Inputs From Inverse Process Function 21 

12. Replicated Calibration 21 

12. 1. Computation of Replicated Design Matrix 22 

12.2. Replicated Moment Matrix for Linear Single-Output Process 22 

12.3. Replicated Moment Matrix for General Single-Output Process 24 

12.4. Analysis of Variance for Estimation of Bias and Precision Uncertainties 25 

12.5. Stationarity Test of Estimated Parameters 27 

13. Examples 28 

13.1. Calibration of Single-Input Single-Output Nonlinear Sensor 28 

13.2. Two-Input Two-Output Linear Instrument 30 

14. Concluding Remarks 33 


m 



Appendix Mathematical Derivations 35 

Al. Preliminaries 35 

Al.l. Extended Lea.st-Squ ares Analysis 35 

Al .2. Lemmas and Theorems 35 

A1.3. L in ear Least -Squares Estimation 40 


A2. Effects of Process Modeling Error 


14 


A3. Nonlinear Least-Squares Estimation With Input Uncertainty 

A3.1. Residual Sum of Squares 

A3. 2. Confidence Intervals 

A 1. Analysis of Replicated Calibrations 

A 4.1. Single-Input Single-Output Process With Uncorrelated Uncertainties 

A 1.2. Cion oral Multi-Input Single-Output, Process 

A 1.3. Analysis of Variance of Replicated Calibrations 

A 4 A. Stationarity Test of Estimated Parameters 


46 

49 

51 

52 

53 


58 

01 


References 


64 


IV 



Symbols 

A,B 

Cum i ^ m n 

B 

b 

C 

Cm 

Ci C,„ 

Cc. 

?R„ 

cos 0 

I) 

Dnk 

d, 

e(c,Z) 

e M . ox 

e, e v 


«k 


f i- 

F 

F r 

Fee 


F rK 
F.j{a) 
f(c.Z) 
f(c, z) 

c„ 

f,.(c,z) 


f 7 (c,z k ) 

6f, 


A' x I\ matrix 

77 / 7 ? ill elements of matrices A and B 
bias error 

offset voltage of angle of at tack sensor 

M r x L coefficient matrix 

M c x 1 parameter vector with elements c w 

M c x 1 estimated parameter vector with elements c w 

globally estimated parameter vector 

M c x 1 estimated parameter vector of nth replicat ion 

A x 1 vector formed by element -by-element cosine evaluat ion of A x 1 vector Q 
experimental design, a subset of >3 
jYA x N A block-diagonal matrix 
distance 

A* x I vector function of c and Z 

error vectors 

A x 1 residual vectors 

A x 1 residual vector at 7/th replication 

averaged residual vector 

element ofe k 

ratio of variances 

K x AI C derivative matrix of f(c,Z) with respect to c 
M c x A/ r x A array 

K x M r derivative matrix of f(c,Z K ) with respect to c 

0 percentile value of F-distribution with A j degrees of freedom 
K x 1 vector function of c and Z 

real- value multivariate function of c and z 
mill column of F c 

M r x 1 gradient vector of /(c,z) with respect to c 
ytii column vector of length I\ contained in array F rr 
kth element of vector f rr 

*j 

1 x K gradient vector of / with respect to z 
error vector 


v 



6U 

G 

Gh 

g(C, z) 


z) 

H 

Hr, 

li(c , Z ) 

I 


Ik 


Iw 


i , /, ?n , ?j 
.1 


A 

L 

M 

Mr 

A/, 

A' 

A'/ 

P 

P,„ 


P»; 

Q 

Q, 

Q,„ 


<lw 

R 

r t 


element of error vector 6f y 
A x /. matrix of </_,-( c.j, z) functions 
A A x A 7 A' matrix 

1 x /, row vector of scalar-value functions of C and z 
jth element of g(C, z) 

A x A’ A replicat ion matrix containing N copies of K x A identity matrix I K 
A/,, x A/,, matrix 

1 x A/ r vec lor gradient of S S q with respect to c 

ij tli element oT H E 

identity matrix 

K x A* identity matrix 

diagonal matrix of ones a nd zeros 

subset of in put space 

integer indices 

normalized average predicted output variance' over set 0 

number of calibrat ion observations 

dimension of multivariate function 

order of multivariate polynomial or integer 

length of parameter vector c 

length of extended input vector z 

number of replications or integer 

number of input variables 

uoiLsingular matrix 

orthonormal matrix 

sub matrices of P m 

mill row of RT 1 

M 7 x M 7 weighted moment matrix 
A/,. x A/ r nonlinear moment matrix 
N x N matrix 
quadratic form 

A/ c x M c Jacobian matrix of S S q with respect to c 

N x A : mat rix 

submatrix of R r of rank ?•„, 


vi 



% vw 


J- 


»A 


Cm 


s.u 

S s <; 

$sc 


Sy 


Ss \{ 


'\s' fin 

b S\Y 

-S' V 

lS 'v 

sin 0 


7ioo 1 x \f 

I 

M'O 

U 

V 

v 

w,w*- 

w f .w Fa 

x 

x 

X 


X*. 

Y 

y 


set of real numbers 

A/-dimensional space over set of real numbers 
rank 

rank of matrix A 
rank of matrix Qm 
sensitivity of AO A sensor 
standard errors of regression 

standard error due to measurement uncertainty after replication 
total residual sum of squares 

total residual sum of squares of N replications with parameter substitution 

residual sum of squares of nth replication with parameter substitution 

sum of squares due to measurement uncertainty after replication 

inner product to be minimized by least-squares estimation of parameter vector 

total residual sum of squares of N replications 

residual sum of squares of nth replication 

quadratic form 

sum of squares due to bias uncertainty after replicat ion 
standard error due to bias uncertainty after replication 

[\ x 1 vector formed by element-by-element sine evaluation of K X 1 vector 0 

variance ratio 

ratio 

/-dist ribut ion with /• degrees of freedom at confidence level o 
symmetric positive definite matrix 
variance error 

transformed output or observation vector 
matrix, subscript I\ denotes dimension 
matrix, subscript /\ denotes dimension 
1 x N input vector 
applied scalar input 
estimated applied scalar input 

At h applied 1 x N input vector of experimental design 
I\ x L matrix of observed output vectors y k . 

K x 1 calibration observation vector 


vn 



V 


Vk 


yi- 


Vo 


//■>(•? o) 

ih 

z 

Z K 


Znk 
z. z(x) 




Z(1 


a 

ii 


I 


7 

7(Z) 

7(z) 


E v . E e 


< / 


«v 

fix, 

C(l 

Cw 

n 

v 

A 

A 


/i-v 


observed scalar output 

Art li observed scalar output 

kth observed output vector 

new olxservation for input z ( > after calibration 

partial derivative of output y with respect to input x 

predicted scalar output for input vector z 

predicted value of new observation ;t/ n 

K x M 7 general design mat r be 

I\ x M 7 submatrix of A7\ x M 7 replicated design matrix Z NK 
N l\ x M 7 replicated design matrix 
My x 1 extended input vector obtained from input x 
element of extended input vector z 

1 x My extended input vector from kth row of design matrix Z 

new extended input vector after calibrat ion 

angle of attack or confidence level; ratio 

vari able 

matrix 

transformed coefficient vector 
[\ x 1 vector of modeling errors 
modeling error 

/\ x L matrix of measurement, uncertainty vectors e v *. and e E/S .. 

I\ x 1 measurement error vector 

scalar measurement uncertainty 

I\ x i measurement error vector at nth replication 

transformed h x 1 measurement error vector 

uncertainty vector of kth applied input x* 

imcertainty of new measurement 

transformed vector 

I\ x 1 vector of angle of attack sensor out puts 
angle of attack sensor output 
diagonal matrix of eigenvalues 
element of A 

expected value of vector v 


vm 



N x 1 vector 


£ 

£ m r m x 1 subvector of £ 

Pij yt.li element of inverse moment matrix Q 1 

p-y ( z ) quadratic form 

S e . S yi . . . covariance matrix of vector denoted by subscript 

S Zij covariance matrix of input vector’s z, and Zj 

<j F standard deviation of measurement error 

a,, covariance of 7 th and jth output measurements 

a v ijih ('lenient, of measurement uncertainty covariance' matrix S E 

cr y variance coefficient of S Y 

rA ( z ) variance function of variable // 

(To standard deviation of new measurement 

</> misalignment angle of angle of attack sensor 

\ a o percentile value of chi-square distribution 

Q volu me in t. eg r a 1 of i n pu t. s ubs] > acc ' 3 

il F ,il FK .$l k A* x I\ matrix 

() K K x A matrix of zeros 

General notation: 

c,„. 7'ritli row of matrix C 

c.„ nth column of matrix C 

£ expected value operator 

P T - [P- 1 ] T 

T matrix transpose 

t.r(A) trace of matrix A 

8 uncertainty operator 

average value 

predicted value or least- squares estimate of associated variable 
o element-by-element multiplication of equally dimensioned matrices 

0 inner product of vector with columns of three-dimensional array 

Bold capital letters represent matrices 

Bold integer subscript denotes dimension of matrix 

Bold lower case letters represent vectors 


IX 



Bold 0 or 1 denotes a vector of zeros or ones, respectively 
Italic upper and lower case letters represent scalars 

Lower case subscripts represent indices: at denotes vector element; a mn denotes matrix element 
z t- denotes A* tli vector of sequence of vectors 

Subscript 0 represents new measurement 


x 



1. Summary 

In 1993, a detailed uncertainty analysis of the six-component strain-gauge balance was 
undertaken for the first time in wind tunnel tests at the Langley Research Center to provide 
confidence and prediction intervals of the outputs as functions of the measurands instead of using 
a general root -mean-square error quantity per component as a percentage of full-scale output. 
The success of this effort, published in 1994 as AIAA-94-2589, has demonstrated the need for 
similar analyses of the other wind tunnel instrumentation in use at Langley. 

The present publication develops and documents a generalized set of mathematical tools 
needed for thorough statistical analyses of instrument calibration and applicat ion. A compre- 
hensive unified treatment directed toward wind tunnel instrument calibration was not found in 
the literature. 

2. Introduction 

Aerospace research requires measurement of basic physical properties such as aerodynamic 
forces and moments; strain; skin friction force; model attitude, including pitch, roll, and yaw 
angles; translational position; temperature; pressure; mass-flow rate; and other properties. 
The aerospace industry now requires that experimental aerodynamic data be furnished with 
uncertainties specified at a statistical confidence level, typically 95 percent . This requirement, 
in turn, imposes the need to quantify the uncertainty of each basic physical measurement at the 
transducer and instrument level in the test, facility as a. function of the corresponding property 
value at the specified confidence level. 

A standard method for treatment of measurement uncertainty in gas turbine engine perfor- 
mance testing was developed by Abernethy et al. (ref. 1). Based on National Bureau of Stan- 
dards handbooks. Abernethy separated elementary measurement errors into two components; 
precision error, which is a zero-mean random error due to measurement scatter, and bias error, 
which is syst ematic and repeatable although unpredictable. T he uncertainty of a final computed 
parameter is determined by propagat ion of individual measurement uncertaint ies through the 
functional expressions which define the parameter, usually by means of multivariable daylor s 
series expansions. The final total uncertainty equals the root -sum-square of the propagated bias 
and precision uncertainties. 

Abernethy s techniques were extended and formalized into an American National Standard 
(ref. 2). Coleman and Steele (ref. 3) provide a detailed academic development, of the standardized 
uncertainty analysis specified in reference 2 that includes statistical concepts, experimental 
design, the effects of replication, and confidence intervals. Reference 3 also provides practical 
details for application of the standard to engineering practice. It introduces the concepts of 
generalized uncertainty analysis for the conceptual validation of a proposed experiment and 
detailed uncertainty analysis for processing experimental results of a completed experiment. 
The useful concept of "fossilized bias uncertainty ” resulting from the acceptance of calibration 
data is introduced. 

An international standard for wind tunnel data uncertainty analysis has been developed by an 
AGARD working group (ref. 4), which provides a standardized approach for estimating precision 
and bias limits, for error propagation computation, and for determining confidence intervals of 
the computed results in the wind tunnel testing context. Bat, ill (ref. 5) has applied AGARD 
techniques to the data reduction problem at the National Transonic Facility. 

The present, publication extends the analysis of instrument calibration uncertainty presently 
addressed in the uncertainty analysis literature. Specifically, correlated measurement, precision 
error, calibration standard uncertainties, and correlated calibration standard bias uncertainties 
are considered. The effects of mathematical modeling error on calibration bias uncertainty 



are quantified. Statistical tests for detection of modeling error and calibration standard error 
through the use of replication are developed. The effects of experimental design on precision 
and bias uncertainties are also investigated. 

Measurement uncertainties of individual measurements during calibration and experimental 
testing have usually been considered to be statistically independent to facilitate computations. 
The extensive use of multichannel multiplexed data acquisition systems with common amplifiers 
and analog- to -digital converters introduces correlated measurement uncertainties which may be 
significant. This publication allows rigorous treatment of correlated measurement uncertainties 
whose covariance matrix is known. 

During calibration, the uncertainties of the calibration standard are generally neglected by 
assuming that their level is at least 1 order of magnitude less than that of t he instrument being 
calibrated. Often calibration standards must be used which do not satisfy this assumption. In 
addition for calibration, the common use of stacked deadweight loadings for load cell, strain- 
gauge balance, and skin friction balance introduces significant correlated uncertainties that 
can magnify the resultant instrument calibration uncertainty several fold. Similar effects can 
occur during calibration of any instrument with a similar “standard instrument" such as a load 
cell or skin friction balance. This publication develops the rigorous statistical techniques for 
computation of calibration standard covariances and their inclusion in calculation of overall 
instrument confidence intervals. These techniques have been applied to calibration uncertainty 
analysis of the six-component, strain-gauge balance as described in reference b. 

Precision errors are traditionally viewed as zero-mean random variables whose uncertainties 
can be reduced without limit by replication as shown by the central limit theorem (ref. 7). 
However, the presence of systematic bias errors during calibration can lead to unrealistically low 
computed standard errors when very large calibration experimental designs are used. The large 
number of degrees of freedom can inadvertently reduce the portion of the standard error due to 
bias uncertainty if correlation effects are neglected. 

Other specific work is in progress that applies this analysis to important wind tunnel 
instruments, including invariable transducers such as load cells and skin friction balances, and 
multivariable transducers, including the strain-gauge balance and inertial mode] attitude sensors. 
Other systems should be analyzed in the future. 

3. Instrument Modeling and Calibration Experimental Design 

Instruments are routinely calibrated by means of analytical models through the use of 
multivariate regression analysis to estimate calibration parameter. To quantify statistical 
confidence levels of measurements obtained by a calibrated instrument, the uncertainty of 
predicted outputs mast he estimated as a function of the input value through the use of the 
analytic model. 

3.1. General Multivariate Process 

A formal mathematical representation of a multivariate (multiple-input ) -single- output. static 
process, including stochastic components, is presented to describe the steady-state input- output 
relationship for an instrument. The analysis does not include transient effects. 

Let and denote A/ r and M 7t dimensional Euclidean spaces, respectively, where 3? is 
the set. of real numbers. Consider a real- valued multivariate function / of l\l 7t x 1 input, vector 
z G 3? w *, and M r x 1 parameter vector c G 3? A/r . Function / maps the Cartesian product of 
spaces 3? :Ur and 3f :U * into the set of real numbers 3?; thus. 


/ : 3f A,r x => » 


( 1 ) 


2 


The notation /( c, z) denotes the output value of the function, an analytic model of a physical 
process dependent upon stochastic input vector z and deterministic parameter vector c. 

The observed output y of the process is generally a measured volt age whose uncertainty by 
depends upon both the uncertainty of the applied input 6z and the uncertainty of the stochastic 
process measurement a zero-mean random variable which is independent of bz. Thus the 
observed output is 


y = /(c,z + 6z) + 6/ (‘^) 

where stochastic input vector z has been replaced by the sum of deterministic vector z plus 
stochastic input uncertainty vector bz. The purpose of calibration is to estimate parameter 
vector c based upon multiple observations of output y corresponding to a set of selected inputs 
specified by an experimental design. 

3.2. Single-Input Single- Output Process 

An example of a single- in put -single-out put process model in terms of a nonlinear polynomial 
using inner-product notation is presented. Let x denote a known applied input to an instrument; 
let y denote the corresponding observed out put , in electrical units, for example; and let < F denote 
the measurement error, which is assumed to be a zero-mean random variable with standard 
deviation rr. Often the measurement, process can be accurately modeled by an d/th degree 
polynomial of the form 


V — T C|.r -f- (' 2 x “ + . . . -f C\fX u + < y ( d) 

which is seen to be a special case of equation (2). Arranging t he polynomial coefficients into 
CM+ 1) x 1 vector c gives 


c = [c 0 r, . . . c,. u ] T (4) 

Define an (M -f 1) x 1 input vector z, denoted the extended input vector, containing the first. M 
powers of x as 


z(x) = [l X x 2 ... x u ] T (5) 

The functional notation z(x ) is used in the subsequent development only when need (id for clarity. 
Equation (3) can then be expressed in inner-product form as 

y- Z T C + f/r (6) 

Note that although the actual process input is scalar variable x , the process model function / 
is constructed as a multivariate linear function of the (M + 1 )t.h element input vector z which 
is. in turn, a nonlinear function of x. 

3.3. Lineai‘. Polynomial, and Nonlinear Multivariate Processes 

More general notat ion suitable for representation of linear, polynomial, and general nonlinear 
multivariate processes is presented. Consider a multivariate process with vector x denoting a 
1 x Nr vector of input variables, 


3 



x = [x, *2 ••• J-v,] 


The multivariate process is represented by equation (()) where y is a linear funct ion of an My x 1 
extended input vector z represented by 


z = [1 z 3 ... ... U J T (8) 

where z\ = 1. For a univariate linear process, the elements of z, generated from input variable 
x, cpnsist only of [1 x] T . For a univariate polynomial process, vector z consists of the powers of 
x from degree 0 through M as shown in equation (5). For a multivariate linear process , vector 

z consists of the independent variables z(x) = [l[x] T . For a multivariate polynomial process , 
vector z contains the powers and cross products of the elements of x from degree 0 through A/. 
For example, if N f = 3, then x = [x\ x- 2 if M — 2, then A/ z = 10; and z(x) is given by 


*(x)= 1 


X\ 


X'2 X.i X] 


X | X 2 XlXl 


J 


X'2XZ 



For a multivariate polynomial process of power M. the lengt h of z is equal to 


(0) 


M 7 


{Nf + M)\ 

Ni IM ! 


( 10 ) 


For example, for a six-component strain-gauge balance modeled by a second- degree multivariate 
polynomial where Nj — (5 and M = 2, the length M 7 of vector z equals 28; that is, z contains 
28 terms. Finally, for a general nonlinear multivariate process , z is identical to input, vector x. 

3.4. Calibration Experimental Design 

The experimental design for instrument calibration consists of a set of input values applied 
by using calibrated input standards for which the instrument outputs are observed. The 
calibration dataset is used to estimate the parameters of the mathematical model. Notation for 
representation of t he experimental design and a figure of merit are introduced. 

To estimate parameter vector c during calibration, output y is observed for A values of 
applied input vector z contained in a representative subset G of input space 3? Uz . Subset T is 
selected to cover the anticipated operating envelope of the instrument. The experimental design, 
1) C T, is ideally chosen to minimize the variance of estimat ed process output y averaged over 
T, with parameter vector c obtained by least-squares estimation. Box and Draper (ref. 8) define 
a design figure of merit J as the average predicted output variance over set T, normalized by 
the number of calibration points K and measurement variance <7 2 to remove the effects due to 
t he number of points in design D, and measurement noise. Thus, 


A ' L <T y( 2 ) dx 

L dx 

where rr'’( z ) is the predicted output variance function defined later. 

4 


(11) 
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After determination of subset D C 3, construct A x M 7 design matrix Z from the elements 
x*. € D, where the Art h row of Z equals the Art, 1 1 extended input vector z(x/ . ) for k — 1 ... A as 
follows: 


Z = 


z(xi) T 

z(x*J T 

x(xa ) t 


( 12 ) 


Arrange the corresponding observed output rallies and measurement errors into observation 
vector y and measurement, error vector respectively, each having dimension of A x 1 as 


y = [y\ Vi ■ • • Vh] T ( 1: *) 

and 

€b = [o.| </:, 0,J T (W) 

where measurement error vector e E has zero mean and A x A covariance matrix £ E - For linear 
and polynomial models, equation (6) is extend'd to a matrix form for K observat ions with the 
help of equations (4) and (12) through (14) as 


y — Zo + e Fj (lb) 

4. Generalized Linear Multivariate Regression Analysis 

Multivariate linear regression techniques are developed (ref. 9) for least-squares estimation of 
coefficient vector c in equation ( 15), denoted by c, where the measurement errors are correlated. 
Techniques are also provided for determination of confidence intervals for c and for confidence 
and prediction intervals for new measurements based on the calibrated value of c. Measurement 
error covariance matrix is assumed to be symmetric, positive definite, and expressible in the 
form 


E e = <t£ U (Hi) 

where K x A matrix U is a known symmetric positive definite matrix and a 1 is a scalar 
to be estimated. If the K calibration observations are uncorrelated, then covariance matrix 
£ e is diagonal. Otherwise a linear transformation must be applied to output vector y 
to diagonalize £ E , which decorrelates the observations. If measurement error vector e E Is 
normally distributed, the decorrelated observations are independent, a necessary condition for 
computation of confidence intervals using chi-square and /-distribut ions (ref. 7). Detailed proofs 
of the following results are given in the appendix. 
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4.1. Decorrelation of Covariance Matrix 

A coordinate transformation is applied to observation y which diagonalizes measurement 
covariance matrix S E . Because matrix U is symmetric and positive definite, a nonsingular 
mat rix P exists such that U can bo decomposed into the matrix product as follows: 

U = PP T (17) 

Define transformed observat ion vector v as 

v = P~'y (18) 

liquation ( 15) can now be transformed through a change of coordinates into the following: 

v “ P _l Zc + e v (19) 

where e v = P 'ce file covariance matrix of v is given by 

S v = P- ] S E P- T = afj (20) 

where P“ T = (P- I ) T : 

thereby, t he elements of v are confirmed as uncorrelated (ref. 9). 

4.2. Least -Squares Estimation of Process Parameters 

I he least -squares estimate of coefficient vector c, denoted by c, is obtained by minimizing 
the following inner product with respect to c: 

Ssq = (v - P“ ! Zc) T (v - P Zc) 

= (y - Zc) T U“'(y - Zc) (21) 

Note that S S q equals the residual sum of squares of the multivariate regression on vector v and 
that the regression is equivalent to least-squares estimation of c on vector y, weighted by the 
inverse of measurement uncertainty covariance matrix S E . Define M ? x M 7 weighted moment 
matrix Q as 

Q= Z T U'Z (22) 

The least-squares estimated coefficient vector c is obtained as 

c= Q "Z T U "y (23) 

The expected value of c equals c and its covariance matrix is given by 

s f =4Q'' (24) 
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Define I\ x 1 predicted output vector v = P 1 Zc. and define A x 1 residual vector e v by 


e v = v - v = W K e v 


( 25 ) 


where A x I\ matrix W K is defined as 


W K = I K - ih 


( 2 ( 5 ) 


I K is the K x f\ identity matrix, and fi K defined as 


to K = (P’ , Z)Q"'(P“ , Z' t 


(21 


Note that fl K is symmetric. Residual vector e v has zero expected value and covariance matrix 


S„ =4 W K 


[281 


The residual sum of squares Ssf obtained by minimization of equation (21), is defined as 


Ssf. = ejov = cJWkCv 


m 


The standard crwr of t he regression, defined as 


S f = 


*\s7 


1/2 


A’ - A A 


( 30 ) 


has exj>ected value £[S F ] — cr F and is thus an unbiased estimate of uy. 

5* Confidence and Prediction Intervals 

The confidence interval for a statistical variate, such as the estimated parameter vector or 
the predicted process output , is a closed interval within which the variate is computed to lie at 
a specified probability or confidence level. See references 7 and 10 for detailed definitions. 

5.1. Confidence Intervals of Estimated Parameters 

If error vector e v is normally dist ributed, then S s ?■:/<?}■ is chi-square distributed with K — M 7 
degrees of freedom. It follows that a confidence ellipsoid for estimated coefficient vector c at 
confidence level 1 — o is given by the following inequality: 

(c - c) T Q(c - c) < M x S'jrF\,' .K-uJn) OU 

where F;j(<k) is the a level of the F-distribution with ij degrees of freedom (ref. 7). The 
length and direction of the semiaxes of the ellipsoid are determined from the eigenvalues and 
eigenvectors, respectively, of matrix Q. 
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5.2. Calibration Confidence Intervals of Predicted Process Output 

The calibration confidence interval is the closed interval within which a predicted process 
output is computed to lie based on the calibration uncertainty. Lot y(z) denote the predicted 
scalar out put for arbitrary input vector z hast'd on estimated parameter vector c; t hat is 


y(z) = z T c (IV2) 

The expected value of y{z) equals z T e and its variance is given by the following quadratic form: 

= Cf z t Q~'z (33) 

Equation (33) equals the variance of the calibration based on estimated parameter vector c. 
Matrix Q, dependent only upon the experimental design Z and covariance matrix £ v , is fixed 
after calibration. Hence, the calibration uncertainty becomes a fixed deterministic function of 
applied input vector z. If € v is normally distributed, a confidence interval at, level a for predicted 
value y( z) is specified by t he following inequality: 


I// - v I < ( « t Q - 1 z ) m S K t A- ( £) ( :M ) 

where / x (c> ) is the o-perceulile value of the two-tailed /-distribution with k degrees of freedom 
(tvf.fi). 

5.3. Prediction Interval of New Measurement 

The pie diction interval is the closed interval within which the predicted process output 
is computed to lie due to both calibration uncertainty and the uncertainty of a single new 
measurement . After calibration, let denote a new observation of the response of the instrument 
to input zo, with uncertainty e<j and standard deviation <to that is independent of calibration 
measurement error vector e v . The observed value y {) is given by 

j/n = zjc + <„ (35) 

The predicted value of the new observed ?/o obtained from equat ion (32), t hat is, the calibrat ion 
curve, is given by 


Mj = zjc (36) 

The prediction error 6y iU defined as the difference between the observed and the predicted 
observations, is given by 


<St/ 0 = y , i - y n = z„ T (c - c) + ( 37) 

and lias zero mean and variance 

^( z u) = a l + z i[Q ~ ' z o (38) 
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The prediction interval at confidence level a- is specified for j/„ as follows: 


\y - j/o I < 



Tn-1, 


+ <Q 


s, <*-,„(!) 


(•'«>) 


This inequality represents the uncertainty of a single measurement after calibration. Note that 
prediction error is composed of two components: the uncertainty of the new measurement 

whose variance is and the calibration uncertainty whose variance, given by equation (33), is a 

determinist ic fund ion of applied input z„. The uncertainty of the new measurement is a precision 
error which can be reduced by replicated measurements, whereas the calibration uncertainty is 
a fossilized bias error (ref. 3) dependent upon x u that, after calibration, does not decrease with 
repli cation . 

6. Computation of Inferred Input With Confidence and Prediction Intervals 

During instrument application an unknown input x {) is applied, and output y {) is observed. 
The desire Is to infer input x {} from observation y {) by inverting the calibration equation (eq. (3(5)) 
rewritten as 

(40) 


Solve equation (40) for x and denote the solution by 2 n , the estimated inferred input. Whenever 
z(x) is nonlinear, solution of equation (40) may require an iterative computational technique. 
Calibration confidence intervals and prediction intervals of inferred input .?* n are obtained by 
dividing equations (34) and (39) by yr(x) and yx(x n), respectively, where 


y.v(*) 


dz r {x) ^ 

c 

dx 


(41) 


Then the calibration confidence interval of the inferred input, obtained from equation (34), is 
given by 


\x — x\ < 


[z T ( x)Q ] z( J-)]' 7 ' .S'; (oil 2) 

vAx) 


(42) 


Similarly, the prediction interval of the inferred input,, obtained from equation (39). is given by 


J 'n 


< 


[v'nlv 1 + (x 0 )Q 1 z 0 ( j-,i )] S, t A _ U/ (o/2) 

/A( 5’ri ) 


(43) 


7. Calibration Uncertainty Caused by Combined Input Errors and 
Measurement Errors 

In general, overall ca libration uncertainty arises from input calibration standard uncertainties 
as well as from output measurement uncertainty. The previously developed analyses are extended 
to accommodate uncertainty in applied input x as well as measurement uncertainty e , . Consider 
the combined effects during calibration of the uncertainty of the kth applied input vector Xt, 
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denoted by c^., and the corresponding measurement uncertainty . The uncertainty of the 
h\h extended input vector z<., denoted by Al 7 x I vector ^z*., is obtained as 


dz/,. = z( X/. + e xi> , ) — z(xj.) (44) 

Vector has zero expected value and M 7 x M ? covariance matrix E Zu ; the uncertainties of 
the elements of z^ may be correlated. In addition, every pair of input vectors z } and Zj may 
be correlated with covariance matrix E z . Design matrix Z, defined in equation (12), then has 
l\ x M 7 uncertainty matrix bZ constructed as follows: 


SZ = 


dz! 


bzj 


bz[ 


(45) 


which has expected value 0. where 0 is a A x A/ z matrix of zeros. Eacli ('lenient of input 
uncertainty matrix b Z is assumed to be independent of measurement error vector e E defined in 
equation ( 14 ). 

The ol)serv('d output vector y corresponding to the actual input mat rix Z -f bZ is given by 


y — (Z + />Z)c + €e 

and the combined output error vector, denoted by by, is given by 


(46) 


by = y - Zc = <*>Zc + e E (47) 

which has expected value 0. The K x A’ covariance matrix of combined output error vector by, 
denoted by £ y , is computed element -by -element with the following equation (eq. (48)) for i = 1 
to I\ and j = / to A . Because bZ and e E are independent, the covariance between elements 
b y, and byj of by is obtained as 


cov (6y,,£y j) = £ [c^-^c] +5[c ; e j ] 

- C T £*,. X + <T,J 


(48) 


where <t, , is t lie i j th element of measurement uncertainty covariance matrix Sr. 

Rewrite equation (47) to express observed output vector y in the form of equation (15) as 


y = Zc + 6y 


(49) 
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where y has expected value Zc. Least-squares estimation of coefficient vector c proceeds as 
before, after replacing vector e v by Sy and matrix X v by respectively, in equations (16) 
through (39). An analysis of variance for replicated calibrations of a multi-input-single-output 
sensor presented in the subsequent development- provides a test of significance for t he presence 
of calibration bias error due to loading uncertainty. 

8, Effects of Process Modeling Error 

Models of instrument steady-state input-output relationships are typically approximate 
empirical relationships such as multivariate polynomials. The effects of modeling error and 
experimental design on calibration uncertainty are quantified, based on generalized multivariate 
linear regression analysis. Calibration standard uncertainty is neglected. 

8.1. Uncertainty Analysis of Modeling Error 

Let process /( c, z) be modeled as a linear function of an extended input vector z according 
to /( c,z) — zc. whereas the actual functional relationship is given by 


y( z) = / (c, z ) — zc + 7 ( z ) ( 50 ) 

where 7 (z) represents the modeling error. However, the system is calibrated by using experi- 
mental design matrix Z based on the linear model of equation (()). During calibration the Hh 
observation is given by 


Vk - z*c + 7 (z/.) + ( Ei 
which is extended over A observations into matrix form as 


( 51 ) 


y = Zc + 7 (Z) + e E (52) 

where ^(Z ) is the A x 1 vector of modeling errors. Coefficient vector c is estimated by means 
of equation (23); the expected value of c, biased by the modeling error, is given by 

£(c) = c + Q~'Z T U -I 7 (Z) (53) 

Predicted calibration output vector y is obtained by using equation (32). Then the expected 
value of y is given by 


€(y) = Zc + ZQ-'Z t U-'7(Z) (54) 

where the second term represents the predicted output bias error due to modeling error. Residual 
vector e v , defined in equation (25), is found to be 


e, =Wk[P-'-KZ)+€ v ] 


(55) 
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and from this the expected value ofe v is 


£[e v ] = W k P-’ 7 (Z) 


(56) 


The covariance matrix of e v is given by 


( 5 1 ) 

The expected value of weighted error sum of squares $ sf . given in equation (29) equals the 
following: 


f[Ssr] = ( K - A/z)<r| + 7 T (Z)P' T W K P"' 7 (Z) 


( 58 ) 


It is seen that Sfr , given in equation (30), becomes a biased estimate of a whenever modeling 
error 7 (Z) is nonzero. 

The variance function (ref. 8) of predicted output y is computed by using the above results 
as is now shown. For arbitrary vector z, the predicted output is given by equation (32). 
The corresponding actual output function value y without measurement uncertainty, shown 
in equation (50), is given by 


y(z) = ze + 7 (z) 

The corresponding predicted output error Sy is then 

fiy{z) = y{ z) - y{ z) 

= 7(z)- Z Q-'Z t U- | [ 7 (Z) + £ E ] 


(•59) 


(60) 


To find the variance function of y s take the expected value of the square of equation (60) and 
after some algebraic manipulation, the following result is obtained: 

<t|(z) = 4z t Q-'z+ [7(z)- Z Q- i Z t U-' 7 (Z)] ;! ( 61 ) 

The first right-hand term of equation (61), identical to the predicted output variance function 
of the model previously given in equat ion (33 ), represents the portion of the bias uncertainty of 
the predicted output due to calibration measurement uncertainty. The second right-hand term 
of equation (61) represents the portion of the bias uncertainty of the predicted output due to 
modeling error. 

8.2. Design Figure of Merit 

Design figure of merit J defined in equation (11) ls obtained by integrating equation (61 ) over 
input subspace 3. It allows examination of the effects of the experimental design on predicted 
output error due to precision uncertainty and bias uncertainty. As in reference 8, figure of merit 
J is separated into variance error term V and bias error term B : 

12 
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J = V + B 


( 62 ) 


The precision uncertainty portion of J obtained from the first right-hand term of equation (61) 
equals 


V — I z T Q *z dx (63) 

Similarly, the bias uncertainty portion of J obtained from the second right-hand term of 
equation (61) equals 

/* = I [7(a) ~ aQ"'Z T 7 (Z)] 2 dx (64) 

where ft is the volume integral of subspace T given by 



8.3. Effects of Experimental Design oil Figure of Merit 

The effects of the experimental design on calibration uncertainty due to measurement 
uncertainty and on calibration error due to modeling error are quantified by means of figure of 
merit J . Simultaneous minimization of V and B imposes conflicting requirements on selection 
of experimental design D. Equation (63) indicates that precision uncertainty V tends to decrease 
as the vector length magnification of matrix Q increases. The vector length magnification of 
Q tends to increase as the distance of the design points from the origin increases, generally to 
the houndary of volume T. On the other hand, reference 8 demonstrates that bias uncertainty 
B tends to be minimized by uniform placement of test points throughout space T. Hence, t he 
accepted practice of uniformly spacing test points from zero input, to full scale input, and back 
to zero can reduce calibration uncertainty caused by improperly modeled phenomena- such as 
nonlinearity and hysteresis. 

A number of well-known methods exist for detection of modeling errors. Examination of 
residual error plots often discloses the presence of systematic errors in addition to random 
measurement errors (refs. 7 and 10). Residual normal probability plots (ref. 10) indicate the 
presence of nonnormally distributed errors which are likely to he systematic. The process of 
detecting modeling error may indicate the functional extension required for model improvement. 
On the other hand, polynomial models should be limited to the minimum order needed to avoid 
fitting data to random noise (ref. 10). 

9. Uncertainty Analysis of Nonlinear Instrument Calibration 

The previously developed generalized linear regression analysis of instrument calibration, 
with calibration standard uncertainty, is extended to include general multivariable-in put -single- 
out put nonlinear processes. 

9.1. Combined Input and Measurement Uncertainties 

Consider a process modeled by nonlinear function y = /(c,z) defined in equation (2). Output 
uncertainty 6y can be approximated as the sum of the different ial of /( c,z) with respect to z 
and measurement uncertainty cf. as follows: 
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m 


bz ( f 

During calibration, K observations are acquired in accordance with K x M 7 design matrix Z 
defined in equation (12). The uncertainty byp of the A*th ol>serval ion yi ■ is given by 

by i - 

where 1 x l\ gradient vector f*(c,z t ) = [df( c,z { .)/dz]. Note that by / is normally distributed if 
both bzi and <■/.- are normally distributed. The actual value of the kth observation is given by 


c)z 


b%i + ( )bz k . + tf.' k 


(67; 


by - /( c, z + <5z) - /(c, z) + (p; = 


<9/(c,z) ~ 

<?z 


3/* = /(e + to/* (68) 

Let f(c,Z) denote the A* x 1 vector function which is obtained by evaluating function /( c,z) for 
each of the A* rows of Z. Also, let y and <$y denote the corresponding A x 1 vectors of observed 
outputs and output uncertainties obtained by evaluating equations (67) and (68) for = 1 to A*, 
respectively. Then y is given by 


y = f(c,Z) + by (69) 

The I\ x A covariance matrix of by, denoted by Ey, is obtained element by element with 
equation (67) as follows: 


Ey,, = f, ( C, Z,. )S z , ( C'(c. '*i) + (T,;, (70) 

where E* is the covariance matrix of the ith and jth input vectors z } and z a,- is the covariance 
of the Ah and jth voltage measurements, and i and j range from 1 to A . If Ey is symmetric 
and posit ive definite, then it can be expressed in the form of equation (16 ) as 


S Y = <r'y\J (71) 

where K x A matrix U is known and can be decomposed into the product U = PP T as shown in 
equation (17). Output vector y is transformed into vector v by equation (18), that is, v = P _l y 
Equation (69) then becomes 

v = p-'f(c,Z) + $v (72) 

where <Sv = P fy The expected value of v is 


£[v] = p-'f(c, Z) 


The covariance matrix of Av is given by 


(73) 
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S v = trl I (74) 

Therefore the elements of 8v are un correlated and 8\ is normally distributed whenever 8y is 
normally d istri bu ted . 

9.2. Least -Squares Estimation of Process Parameters 

The least-squares estimate of parameter vector c, denoted by c, is obtained by minimizing 
the error sum of squares S S q , given by the following quadratic form, with respect to c: 


Ss-y =[v-P-'f(c,Z)] T [v-P-'f(c,Z)] = [y — f(c, Z)] T U _I [y — f(c, Z )] (75) 

To minimize Ssq^ compute the gradient of equation (75) with respect to c and set the resulting 
set of M c equations equal to zero and expressed in vector form as 

li = = [v-p-'f(c,Z)] T p- | F < . = 0 (76) 

where li is a function of independent arguments v. c, and Z; the dimension of li is 1 x M r and 
of vector [v — P _1 f(c, Z)] is K X 1; and A* x M c matrix F r is defined as 


F r (c,Z) = 


dc 


(77) 


Equation (70) can be solved for c by means of a Newton- Ha phson iteration or a similar method, 
provided that the symmetric M r x M r Jacobian matrix of S$q with respect to c, denoted by R, 
is nonsingular in some region about c and Z; that is 


c) 2 Ssq _ dh 
dc 2 dc 


(78) 


9.3. Uncertainty of Estimated Process Parameters 

The uncertainty 8ci of stochastic vector c is obtained in terms of combined output uncertainty 
8\ from the different ial of equation (76) as follows: 


~dh~ 

dv 


T 

8\ + R<5c = 0 


(79) 


where A* x M c matrix [d\i/d\] equals 


dh 

dv 


= P T F r 


(80) 


Matrix R is shown in the appendix to be 


R = 


<9h' 

dc 


F^U _1 F r + He 


(81) 
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where the ijtli element of M c x M e matrix H E is given by 


hr, = [v - P 'f(c, Z)] T p- , f rc . i 

where A x 1 vector f crj( is the ij t li column of A/,. x M r x A array F rr defined by 


( 82 ) 


f)F r T (c,Z) _ 

dc dc 2 


(83) 


and 1 < >J < M c . It is seen that the A x 1 vector expression [v — P 1 f(c,Z)] contained in 
equation (82) equals the vector of residuals denoted by e v . Then if the norm of e v is sufficiently 
small, matrix H E can be neglected in equation (81) to yield the following approximation: 


R« FjU _, F r 


m 


From equations (77) to (80), the uncertainty of estimated parameter vector c equals 


be 


'ah' 

-i 

ah 

m dc 


dv. 


T 

<Vv = -R ] F C T P T (Sv 


(85) 


From equation (85), calibration parameter uncertainty be has zero mean, it is normally 
distributed whenever by is normally distributed, and its covariance matrix is given by 


S r 


VyQ 


-1 


( 86 ) 


where 


Q 0 EE [R-'FjU-'F.-R"']’' (87) 

If approximation (84) holds and if the rank of K x M c matrix F r equals M r , then mat rix R is 
nonsingular and matrix Q r is approximated by 


Q r % R 


( 88 ) 


9.4. Residual Sum of Squares and Standard Error of Regression 

Let v denote the predicted calibration output vector corresponding to design matrix Z and 
estimated parameter vector c, where 


v = p-'f(c,Z) 


(89) 


The vector of residuals e v is defined as follows: 


e v = v - v = P '[f(c, Z) — f(c, Z)] + bv 


(90) 
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which is represented in differential form as 


e v = P 'F^c, Z)6c + (Sv = (I K — SI F )/>v 


(91) 


wliere A x A matrix lip is 


« F = (p- | F 1 .)ir l (p- | F,.) T 


(92) 


The expected value of e v equals zero, and the covariance matrix is given by 


£, =rr;<(I K -rt P ) (93) 

An unbiased estimate of <Ty is now obtained. The residual sum of squares is defined as 

Ssf = = *v T (I K - ilr)bv (94) 

As shown in thr* appendix, Ssr./cTy is chi-square distributed with K — M c . degrees of freedom, 
and the expected value of S^ { . is 


£ ( Ssi; ) - (A - M'Wy 


(95) 


Therefore an unbiased estimate of ay is given by standard error , which is defined as 


■SV = | 

A confidence interval for a y at confidence le 

( I\ — M r ) ] f J Sy 

\( 1 +M )/2 


£>sf 


i n 


K - A/ r , 
vel a is given by 


< <7 y < 


(A - M r )'/ 2 5 v 
\< I-")/* 


(96) 


(97) 


where \ fl is the a-percentile value of the chi-square distribution with A — M c degrees of freedom. 

9.5. Confidence and Prediction Intervals of Predicted Output 

The confidence e Hi j>soi d for estimated calibration parameter vector c is defined by the 
follow in g i ne q n al i ty : 


(c - c) t Qc(c - c) < McS l yFM e .K-M r (<*) (98) 

where F\ fr *-_*/,.( a) is the a-percentile value of the A- distribution with M r , A — M c degrees of 
freedom. 

After calibration, consider z 0 as an arbitrary deterministic input. The corresponding 
predicted value yo — /(c, z (i ) is computed by using calibration parameter vector c. The 
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uncertainty by of y due to calibration uncertainty alone is obtained from the differential of 
equation (2) as 


^2/u = 2/u - ?/i i = /(c, z„) - /( c.z 0 ) 

= f P T (c,z u )6c = f r T (?-,z 0 )R-'Fjp-'<Sv 


(99) 


where A/ P x 1 gradient vector f r (c,z) is defined a.s 


t-(c.Z) 


fl/(<-.z) 

th- 


em 


The variance of predicted value y( z ( i), termed the output ear/ancr function (ref. 8), is given by 
the following quadratic form: 


^(z,,) = of [^(e.zJQc'f^c.z,,)]'^ (101) 

From equation (67) we can see that if uncertainty 6v is normally distributed, $y {) / a, t is normally 
distributed with zero mean and unit variance. Since Sf/af is chi-square distributed with A — A/ r 
degrees of freedom, a confidence interval at level o is given for y as 


I.Vu - /(c.z„)| < [C(c, zJQc'fcdc.z,,)] l/j /„,S' V (102) 

where / f> is the tail of Student's ^-distribution at confidence level o with I\ — M c degrees of 
freedom. Inequality (102) defines the calibration confidence interval 

Let a single new measurement yo be made after calibration by using an instrument for which 
the variance of a single measurement equals af With the use of equation ( 101), the variance of 
the single new measurement is 


<’■*,( *o) = <r>Vj[(*o) + ~ a v 


<T„ 




'V J 


where quadratic form fr Is defined as follows: 


pti Z(|) = f r T (c,z JQc'^tc.Zu) 


The confidence interval at level a of new measurement yo is given by 


Vo ~ /(c,z 0 )| < 


2 1 1/2 


o)+-f 


’VJ 




(103) 


(104) 


(105) 


wliich is termed the prediction interval. 

An analysis of variance for N replicated calibrations of a nonlinear multi-input-single-output 
sensor is obtained in the appendix which provides a test of significance for the presence of 
calibration bias error due to loading uncertainty. In addition, equations are provided for 


18 


computation of matrix R, given hv equation (81), in terms of t he A x A covariance matrices of 
a single replication. 

10. Multivariate Multiple-Output Analysis 

The preceding analysis is now extended to a multi-input multi-output instrument such a.s a 
six-component, strain-gauge balance. Although the notation becomes cumbersome, the extended 
computational procedure simply iterates the previous multi-input- -single-output technique for 
each process output element. 

Consider an A- valued process g represented by a 1 x L row vector of scalar functions of an 
M r x 1 parameter vector c./ and z, each of the form of mapping equation ( 1 ). Let <7,(c.;,z) denote 
the jth function, where j range's from 1 to L, where (jj is dependent upon the corresponding 
A/ r x 1 parameter vector c.,- and 1 x M 7- input vector z which is common over all values of j. 
Arrange the coefficient vectors L into M c x L coefficient matrix C as 


C = 


(*• i 


r.v 


i 

i 


i 


c.r 


( 106 ) 


As usual, A ol)servat ions are made during calibration in accordance with design matrix Z. for 
the At h observation let g, y*.., and € v *. denote 1 x L vectors of functions observed outputs, 
and measurement errors, respectively, where 


g(C,z*) = [r/i(c.i,z*) <y-j(c.a,z*) ... z<.)] 


(107) 


yi- - br i Vk :i ■ Vl j] 


108 ) 


- — [ € rk\ I e rk :2 


Crl'J.j 


(109) 


respectively, where € v <. has zero mean and zj denotes the corresponding 1 X M z input vector 
defined in equation (12 ) as the fcth row of design matrix Z. Then the functional relationship for 
the A* tli observation is obtained by extension of equation (2) to L space as follows: 


y*‘ = g(C,Z / .+ ^Zi.) + €y t . 

- g(C,z*) + tfy*. 


(HO) 


where uncertainty is given by 


fyi- = g(C, Zj, +<5z) — g( C, z k ) T c v j[.. 

’3g(C, z k y 


- 6z i- 


dz 


+ £\k* 


(in) 
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Note that matrix [f?g( C . z )/dz] has dimension M 7 x L. Vector equation (110) is then extended 
to a A' x L matrix equation as shown by the following equations: 


Y = G(C, Z+$Z) + E V 
= G(C. Z) + SY 


( 112 ) 


G(C.Z) 


8(C.*,) 

g(C,z,) 


g (C,z A -) 


( 113 ) 


yi- 

y-2- 

Yk- 


(114) 


€ v ] * 
€ v ->. 


E « — - 


[t v * | . £ v i ^v* ! . J 


115) 


€ v A' • 


Note that I\ x 1 vectors € rll e y . f denote columns 1, L of matrix E v . Also I\ x L matrix 
f>Y is obtained by extension of equation (111) as 


6Y = 


*yi- 

by->. 

by k* 


+ E v 


( 116 ) 


Let Svm.ni denote the K x A' covariance matrix of error vector e v .„ M and S Y m.?» denote the A' x A 
covariance matrix of column in of matrix tfY, wliicli is computed element by element by using 
equation (48) with m ranging from 1 to L and / replaced by g w . Furthermore, define S S Q jn as in 
equation (75) with / replaced by g m for each of the L elements of g. The least-squares estimated 
coefficient matrix, denoted by C, is computed column by column by solving equation (76) to 
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minimize S SQm for m = 1, ..., L, with c. in the 771 th column of C. The covariance matrix and 
confidence ellipsoid for c. w are computed as before with equations (86) and (98), respectively. 

After calibration, the predicted output matrix y for arbitrary input z using estimated 
coefficient matrix C is given by y =g(C, z). The uncertainty by due to calibration uncertainty 
alone equals 


by = g(C. z) - g(C , z) (117) 

The calibration confidence interval for by is obtained element by element by equation (102). 
Similarly, the prediction interval of a new measurement is obtained element by element by 
equation (105). This analysis is illustrated by an example of a two-input two-output linear 
process given in the subsequent development, 

11. Uncertainties of Inferred Inputs From Inverse Process Function 

An instrument is normally employed to infer the value of an input x based on the corre- 
sponding observed output y by means of the process model /( c,z) for the single output cast', or 
g(C,z) for the L-dimensional case, following calibration. Calibration confidence intervals and 
predict ion intervals of the estimated process input are obtained. 

Let g denote both cases in the following discussion. Input z can be computed if inverse 
function g" 1 exists. A necessary and sufficient condition for the existence ofg -1 is that function 
g be bijectire , that is, a one-to-one onto mapping from to If M 7 — L. g is continuous 
and differentiable and if for observed output vector y 0 , an input vector z n exists such that 
y 0 = g(C, z ), then a necessary condition (ref. 11) for the existence of the inverse function g" 1 
is that L x L matrix r)g/<9z be nonsingular in a region about z () . Indeed, the inverse function 
may be obtained by solving the following system of ordinary differential equations obtained from 
equation (ill): 


dz T = dy 


%(C,z) 


dz 


(118) 


Whenever a closed-form inverse function is unavailable, given observed output y () , the corre- 
sponding predicted input value z 0 is computed iteratively from the relation y [} = g(C,z 0 ) by 
means of Newton-Itaphson iteration or a similar method. 

If input z„ were known, the uncertainty by of the corresponding predicted output would be 
given by equation (117). However, since predicted input z n is inferred from known output y u , 
the uncertainty b y 0 is obtained from equat ion (118) as 


= ^yo 


dg(C,z u ) 

dz 


(119) 


where dg/3z must be nonsingular and 6y« estimated by equation (117) with z„ replaced by 
z u . Confidence and prediction intervals for z 0 are then obtained from those computed for y 0 
with equations (102) and (105) followed by transformation (eq. (119)). 

12. Replicated Calibration 

A statistical technique for detection and estimation of bias errors due to either modeling 
error or calibration standard error is now developed, which requires multiple replications of 


21 



the calibration experiment. The use of replicated calibrations over an extended time period is 
important for the following reasons: 

1. To obtain adequate statistical sampling over time 

2. To test for nonstationarity and drift 
T To test for bias uncertainty 

T To estimate bias and precision uncertainties 

The variance of averaged random errors is known to decrease as 1/A" over N replications, 
whereas that of bias errors, which are repeatable, does not decrease with replication. Tests for 
the existence of significant bias uncertainty by analysis of variance are based on this fact. The 
bias test, derived for a general multivariate nonlinear process in the appendix, computes the 
sum of squares $ S \ of the set of I\ residuals averaged over N replications. The mean value of 
S s \ is an estimate of the variance due to bias uncertainty. The mean value, denoted by S\j, of 
the difference S s .\t between the sum of squares S^r °f the global set of N K residuals and S S \ is 
an est imate of t he variance due to measurement error. The variance ratio NS x /$\i provides a 
test of significance for the presence of bias errors. A similar analysis allows detect ion of drift of 
any estimated parameter during replication. Details are given in the appendix. 

12.1. Computation of Replicated Design Matrix 

A re l>H cation matrix is defined which provides convenient computational notation for repli- 
cated calibration experimental designs. Consider a. single-output sensor modeled by an (A/ z — 1 )th 
degree polynomial. The sensor Is typically calibrated by using h standard loadings applied in 
a predefined order, say zero to full scale and back in (K — 1) equal increments, represented by 
A x M 7 experimental design matrix Z K The calibration is replicated N times, described by 
AT x M, design mat rix Znk, where 


Znk — 


Z K 

Z k 


h t z* 


( 120 ) 


and where A x NK replication matrix H equals 


H = [Ik Ik ... Ik] (121) 

12.2. Replicated Moment Matrix for Linear Single-Output Process 

Moment matrix Q is computed for a replicated experimental design for calibration of a 
linear single-output instrument with uncorrelated measurement uncertainties. Use of replication 
matrix H permits computation of Q in terms of the single-replication K x M 7 experimental 
design matrix Z K . Assume that the calibration standard uncertainties are fixed unknown bias 
errors modeled as a zero-mean normally distributed random variable and that design matrix Z K 
has A x A' covariance matrix <t 2 I k . Because complete design Z NK contains N replications of 
design Z K , the N subsets of I\ loadings are correlated with the NK x NK covariance matrix 
£ z of design Znk given by 
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£ z = ^H t H = at 



Ik 

Ik 


Ik 

Ik 

Ik 

Ik 

Ik 


Assume also that sensor output measurements are unco rr elated with covariance matrix 


Ik Ok Ok 

Ok Ik Ok 


£ e _ o\- 


— <T r I]\ 


Then combined input, covariance 


where 


0 K 0 k 


S Y — a’j.Unk 


(o + 1 )I K Ik 
Ik (° + 1 )Ik 


Unk — Ink + ri 'H H — 


( 121 ) 


It is readilv shown that 


(o + 1 )Ik 


U^' =Ink -/m T H =/? 


(1— —I K 

-Ik (1-/WIk 




( 126 ) 
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where 


Not + 1 


( 127 ) 


As shown in the appendix, the M 7 x A L, generalized moment matrix Q NK = Z^ k U n ' k Z N k is 
given by 


Qnk 


cr\ 


{<*1/ A') + <*'i 


ZkZk 


(128) 


The [)ortion of the calibration uncertainty due to calibration standard uncertainty, repre- 
sented by (Tj. in t he denominator of equation (128). does not decrease with replication. On t he 
other hand, the portion of the calibration uncertainty due to measurement uncertainty, repre- 
sented by a] in the denominator of equation ( 128), decreases as N~ l ^ 2 with replication. Note that 
equation (128) permits more efficient computation of uncertainties for an N I\ x M 7 replicated 
experimental design in terms of non replicated I\ x M 7t design matrix Zk because computational 
storage requirements are reduced by a factor of A r . 

12.3. Replicated Moment Matrix for General Single- Out put Process 

The technique developed in the previous section for comput ation of moment mat rix Q for a 
replicated experimental design is extended to a general nonlinear single-output instrument with 
correlated measurement uncertainties. Consider a general multi-input single-output process 
calibrated by using experimental design Z K replicated N times. The K x 1 output uncertainty 
vector of a single replication, denoted by <*>y K , is given by expanding equation (67) for 
k — 1 A. Then for N replications, A7\ x 1 output uncertainty vector <^yNK is given by 


<^yNK — H T 6f z -j- e E ( 129) 

where A x 1 gradient vector 6f z , defined in the appendix, has A x A covariance matrix 
Sj ZK = ^.U fzK and N K x 1 measurement, uncertainty vector e E has N K x N A covariance 
matrix S E = (r'jr U e N K , all defined in the appendix. The measurement uncertainty is assumed 
uncorrelated between replications and the A x A measurement covariance matrix of each 
replication is assumed to be S E|< = ap . From equation (129), 


S V NK = Se + S fzNK = <t 2 f Ue nk + ^Uf ZNK - 4 Uy nk 
where A A x A' A covariance matrix E fzNK is given by 


(130) 


S f/Vk - ^U fz 


rH T U f H 


I ron i equation (131), U Ynk can be written as 


(131) 


Uv NK - U Enk + «U w 
where o is defined in etjuation (125). 


(132) 
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As shown in the appendix, the inverse of NK x NK matrix U Ynk can be expressed in terms 
of A x A matrices U fzK and Uj K . Define A x A matrix B as 

B = [Ue k + {.V - l)oU ( . K ]"' U fzK ( 133) 


and I\ x K matrix A as 


A = (U Ek + oU f „ [I K - ( A' - 1)B]) _I ( 134) 

If the inverse matrices contained in equations (133) and (134) exist, then M 7 x M z moment 
mat rix QnK — ^N K U Ynk Z N K, defined in terms of N I\ x A7 Z matrix Z\x and AA x A/\ 
matrix U Ynk , can he computed in terms of I\ x M 7 matrix Z K and A x A matrices Ik, B. and 
A as 


Qnk = A'Z^Ik - ( N - 1 )B]AZk ( 1 35) 

12.4. Analysis of Variance for Estimation of Bias and Precision Uncertainties 

A test of significance for bias uncertainty due to calibration standard error or modeling 
error and an estimate of the corresponding standard error are obtained by analysis of variance 
techniques, as shown in detail in the appendix. Assume as null hypothesis that the calibration 
bias error Is zero; then matrix Unk equals Ink U[ equation (124). By using equation (27), 
A r A x N K matrix 12 NK becomes 

«NK = ZnkQnkZnk = |rH T Si K H (136) 


where the A x A matrix S 2 k is defined as 


il K = Z K (ZlZ K )-'Zl (137) 

The A A x 1 residual vector e has zero expected value and A A x N I\ covariance matrix <t 2 W nk- 
given in equation (26) as 


W NK - — Ink ~ Unk 

As shown in the appendix, the residual vector e can be expressed as 


(138) 


e — ^V jvjkCf, (139) 

where N K x 1 error vector e E is normally distributed with covariance matrix 0 -'l NK . Let e„ 
denote the A x 1 residual vector at the nth replication, which has zero expected value and 
covariance matrix (t 2 Wk, given in equation (26) as 


W K = Ik - Ok 


(140) 
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Thus, e is partitioned into A\ (A* x 1) subvectors 


r-T -*T -^T 

e = [e, e] ... o'- 


ti t 


(141) 


Let e K denote the mean value of residual vector e„ averaged over N replications; that Is, 


e K 


1 1 - 1 
= -E e ” = - He = - HW 


u=i 


A f 


N 


NK^E 


The total residual sum of scjuares can be partitioned as follows: 


(142) 


Ssr = e T e = 

11=1 


V 

= A'e^eK + y^(e„ — eK) T (e„ — e K ) 

n=i 


(143) 


As shown previously, S' s v, j is chi-square distributed with N K — A/ z degrees of freedom, and 
the standard error of the regression given by 


St: = 


S,SF. 


NK - M 7 


1/2 


(144) 


Ls an unbiased est imate of a. Define the first right-hand term of equation (143) as the sum of 
squares due to bias uncertainty, which can be expressed as 


n ^ j 

Ssx = A <1 — A o Je K = -^eW^GhWnkCe (145) 

where G H = (i/A 7 )H T H Ls defined in the appendix and rq. is the Arth element of Cr. It can 
be shown that S$x/cr 2 is chi-square distributed with K — M 7 degrees of freedom. Variable 
defined as 


S x = 



( 146 ) 


Ls interpreted as the standard error due to bias uncertainty. Define the second right-hand term 
of equation (143) as the sum of squares due to measurement uncertainty as follows: 


v 

Ss. w = ^(e„ — eK) T (e 7 , — gk ) = 4Wnk(Ink — Gh)Wnkce (147) 

h=I 


It can be shown that S S \r/o’ 1 is chi-square dLstributed with NI\ — A degrees of freedom; the 
mean value 
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Sm = 


1/2 


(148) 


Ssu \ 

N l\ - K J 


is interpreted as the standard error due to measurement uncertainty. Chi-square variates Sy / vj- 
and S'i, j(r\ can he shown to he independent. Hence, the ratio S\ / S'{, is F-distrihuted with 
I\ — M z . N I\ — K degrees of freedom; the test of significance for bias error is as follows: 


' ST'' 


h'— M,. . X I\- 1\ 


(«) 


(149) 


If in equality (149) is satisfied, then the null hypothesis is rejected; this indicates the existence 
of bias error at confidence level a. The analysis of variance is summarized in table 1. 


Table 1 . Analysis of Variance of Residual Sum of Squares 


Source of variation 

Degrees of freedom 

Sum of squares 

lloot-n lean -sepia re 

Bias uncertainty 

K - My 

Ssx 

Sx 

M e asu rei ne nt u nc er t aiu 1 y 

NK - K 

-S.s ;\t 

■S'u 

Residual sum of squares 

N l\ - My. 

Ssr = Ss. v + Ss\( 

Sf 


12.5. Stationarity Test of Estimated Parameters 

A test for stationarity of an element c w contained in estimated parameter vector c over A 
replicated calibrations is developed in the appendix. For example, significant variation of the 
intercept, or slope during replicated calibrations may be detected. 

Let c denote the parameter vector estimated globally over N sets of A -point calibrations. Let 
c R „ denote the parameter vector estimated over the A -point data set obtained during the nth 
replication and S$R n equal the corresponding residual sum of squares for n — 1 A Define 

v 

A ,S7? — Rn (150) 

v=\ 


It is shown that S^r/o is chi-square distributed with A r (A — A/ z ) degrees of freedom. 

To test for stationarity of parameter c w , replace the 77/ th element of cr (i by c m 6 c, and 
compute the resulting error sum of squares, denoted by Ssc, ttur for n — 1, . . . , N . Compute the 
su ni 


.Y 



v = \ 


(151) 


It is shown that ( S sa m — S s r) / & 2 is chi-square distributed with N — 1 degrees of freedom. 
Therefore, the ratio [( Ssa ttl — S$r)/(N — 1)]/{Ssr/[N(I\ — A/z)]} is F-distributed with A — 1, 
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A r ( A — A/J degrees of freedom. The test of significance for nonstationarity of parameter c IH is 
then as follows: 


7 \ n 


~ Ssr)/( A' ~ 1 ) 
S sr /[N(K- M,)\ 


Fx-\.X(h~M v ){ a ) 


(152) 


13. Examples 

13.1. Calibration of Single- Input Single- Output Nonlinear Sensor 

Consider an inertial angle- of- attack sensor which senses the projection of the gravitational 
force onto the aircraft model axis. At zero roll, the angle of attack sensor is accurately modeled 
by the following equation: 


7/ — /(c,r>) = , S’ sin (o — 0) T b ( 153) 

where the scalar a. the angle of attack in radians, is the independent variable z; the 3 x 1 
parameter vector is given by c = [6 5 0] T , where b — Offset in l\ S — Sensitivity in l///, 
p — Misalignment angle in radians, and i] is the sensor output in 1. For this example input 
vector z equals applied angle o and bz denotes the uncertainty of <\ during calibration. 

Calibration design matrix Z has dimension A x 1 . Fquat ion (153 ) is extended to A dimensions 
as follows: 


?/ = f (c . Z ) = S sin (z — 0 1 ) + 61 (1 54 ) 

where ?/ denotes the A x 1 angle of attack sensor output vector, z denotes the single column 
of design matrix Z, sin denotes the A’ x 1 vector obtained following element -by -element sine 
function evaluation of the elements of (z — 01), and 1 denotes a I\ x 1 vector of ones. 

Let bz denote the calibration angle uncertainty, and let c F denote the uncertainty of the 
sensor voltage measurement with variance aj-. Then the observed output y is given by 


y = /( c, o + Sz) + er = S sin (a + bz — 0) + b+ ep; ( 155) 

Output uncertainty by is obtained with equations (66) and (153) 


by — S cos (r — <p)bz + (f 


(156) 


Equation ( 156) is extended to A dimensions as follows: 


by — S cos (z — 01) o bz + e E (157) 

where cos denotes the A x 1 vector obtained following element- by-element, cosine function eval- 
uation of the vector z — 01, o denotes element -by -element multiplication of equally dimensioned 
matrices, and by , bz, and ce denote A x 1 vectors of uncertainties 6 V , 6a , and y respectively. 
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The observed calibration output vector, including measurement uncertainty and calibration in- 
put uncert ainty, is thus extended to K dimensions with the use of equat ion ( 153) to the following 
equ ation: 


y = i) + 6y = S sin (z — 01) + 61 + ^y 


(158) 


It can be shown that the K X A covariance matrix of y is given by 

S Y = cov (6y ) = /? 2 [cos (z — (j)l) cos (z — 01 ) T ] o £ z + S E ( 159) 

where £ z and S E are the covariance matrices of 6z and respectively. It is seen that. S Y and 
U given by equation (71) are symmetric and positive definite. 

The least-squares estimate of parameter vector c is obtained by minimization of the following 
quadratic form given in equation (75): 


Ssq = [y — bl — ,S f sin ( z — 0l)] T U Y ‘[y — bl — S’ sin (z — 01)] ( 160) 

The A x 3 Jacobian matrix of f(c. Z) is found to be the following: 


F< (c, z) = [1 [ sin (z — 0 1) [ — S cos(z — 01 )] ( 161 ) 

The least-squares est imated coefficient vector c is obtained by solving the following 1 x 3 system 
of nonlinear equations: 

li(c, Z) = [y — 61 — S sin (z — 01)] T U“'[F r (c, Z)] 

= e(c.Z) T U -l [F r (c, Z)] = 0 (162) 

where e(c, Z) = [y — 61 — S sin (z — 01)]. The standard error of the regression is given by 

( [y - 61 - S sin (z - 01)] T U‘ ! [y - 61 - S sin (z - 01)] | 

_S V _ j j (IM) 

which provides an unbiased estimate of (t f . 

From equation (161), equation (162) may be partitioned as follows: 

li(c, Z) = [e T (c. Z)U“'l J e T (c,Z)U _l sin (z- <pl) | -.9e T (c,Z)lT 1 cos (z - <pl)] (164) 

Then matrix R = [#h(c,Z)/dc], given in equation (81), is found to be 

R = Fj(c,Z)U -l Fr(c.Z) + He (165) 
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where 


0 


0 


0 


H r 


0 


0 


— e T (c,Z)U 'cos (z — 01) 


0 — e T (c,Z)U 'cos (z — 01) ,5c T (c,Z)U 'sin(z — 01) 


(166) 


The covariance matrix of c, denoted by £ c = rrfQ" 1 can now be computed with equation (86). 
The three-dimensional confidence ellipsoid for c is given by equation (98): calibration confidence 
intervals and prediction intervals for predicted output voltages are given by equations ( 102) and 
( 105). respectively. 

Following calibration, confidence intervals and prediction intervals for inferred input angles, 
given observed angle of attack sensor output voltages are now obtained. For this system, a 
unique inverse function of /(c,a) exists for values of o in the interval [— tt/2, tt/2], given by 


a 


(v-A - 

arcsin — - — — 0 

V s ) 


(167) 


Confidence and prediction intervals for a are obtained by dividing equations (102) and (105), 
respectively, by the gradient of /(c,o) with respect to o, where 


df(c.a) 

Oa 


= S cos ( a — 0 ) 


d he desired 95 percent calibration confidence interval for angle a is then 


(168) 


/ a _ ; ^(0.95 )S\p }/ (a) 
S cos (o + 0) 


(169) 


where p !{ {z ) is defined in equation (104). Similarly, the 95 percent prediction interval for new 
measurement a,> is obtained as 


, /A-- S (0.95)5 Y [^(a 0 ) + <K] ,/2 

|tt 0 -a 0 (c)|< (i^U) 

S cos (a, i + <p ) 

where a„(c) denotes the predicted value of new measurement a,, inferred from measured out put 
y g by means of equation (167). 

13.2. Two- Input-Two- Output Linear Instrument 

Consider a two-in put-two-output. linear process — for example, a two-component strain-gauge 
balance with 1 x 2 input vector x = [xq xj, 3 x 1 extended input vector z T = [1 X| x 2 ], 2 x 1 
output vector y = [jq //■_.], and measurement error vector e E = [f| e-J. Coefficient matrix C is 
given by 
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c = [c., ; <■ 


•J = 


r OI c 0'2 
c \\ C V> 

r 2 , c r > 


(171) 


where c.„ = [r 0 „ r,„ r^,,] 1 for n = 1,2. 

For a. single observation, the out put is given by y == z T C + t k During calibration. A 
calibration input vector's are applied, represented by the following A x 3 design matrix Z: 


Z = 


1 ♦Cj] .C|v) 

1 .1*2] J \*'J 


(172) 


1 x !\ 1 X’h’U 

Measurement uncertainty is represented by A x 2 measurement error matrix Er. when' 


Er — [ce.]€ e . 2 ] — 


fll 

c rj 

OJ! 


f A' 1 

f />' *2 

and cr, 

foi 


(173) 


is d ei 1 o t ed by S r m m . 

For A calibration measurements, the A x A ,r output matrix Y is given by 

Y = (Z + <§Z)C + E e 

where A x M 7 input error matrix 6 Z is given by 

0 Sx U 6x 12 

6Z = [0 tfx.^x.J = 

0 fafi-1 

The 2x2 covariance matrix of input error vectors ^x.j and />x.j is denoted by S x ... 


(174) 


(175) 


S x . = 


ff b.l2 rr V,^-J 


(176) 
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Let input vector x he random with zero-mean uncertainty e x — [e X| e x J . Then extended input 
vector zT has uncertainty cj = [0 c,J; A” x 3 design matrix Z has uncertainty matrix E z , 
whose rows and e Zj have 3 x 3 covariance matrix where 


0 0 0 


S z , 

> = e h 

0 

(T\ , | 

•j 1 1 




1 

c 

<T \\ ... 

tjAl 

aX ,,Tl 


(177) 


Consider process outputs t/| and ;t / 2 separately; subscripts are omitted in the following computa- 
tions. The total error vector e Y , expressed as €y = E z c + eg, expands into 


S| C| + + f| 

( J ‘>] C \ i J T1 C ‘ 2 ( '’ 


(178) 


J 

The covariance between elements i m and < !fj of total error vect or ( v is given by 

cov („.) = c T EzyC + (Tij = cja \.. Al + C[C-jax u V , + + on ( 179) 

'Hie confidence interval at level 1 — o for estimated coefficient vector c is expressed as a three- 
dimensional ellipsoid as 


(c - c) t Q(c - c) < 3S* ft. *•_,(«) ( 180) 

The elli[)soid can be characterized as follows: Since Q is symmetric, it is unit aril y similar to a 
real diagonal matrix A; in particular Q = P T AP, where A consists of the eigenvalues of Q and 
P is unitary; that is, PP r = I. Matrix P consists of the set of orthonormal eigenvectors of Q. 
Apply the transformation 7 = Pc to coefficient vector c. The confidence ellipsoid then simplifies 
to the form 


7 T A7 = A,( 7 , - 71) 2 + A, (7 a - y 2 f + A ; ,(7 3 - j 3 )' J < :1S' J F :lA _- s (a) ( 181 ) 


Let A denote the ith eigenvalue of Q. It is readily seen that the ith vertex of the ellipsoid is 
located at distance 


d,= 


'3 S*F 3 . K _ 3 (a) 


A, 


(182) 


from point c in the direction of the corresponding eigenvector, that is. the ith column of P. 
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The uncertainty of the regression function, which is dependent upon extended input vector 
z, is expressed by the calibration confidence interval at level of inequality (34): 


\y - y I < ( z T Q 'z) ]/2 SiK -:)( « ) 

5: {fin + ^P\‘i x \ + 2^13^2 + PTl J ’| + '2p-r . + p: -:l( a ! 


183) 


where pr, is the ij th element of Q 1 . 

After calibration, apply input z 0 and make a single new measurement, where the measurement 
uncertainty is (o. The prediction interval for output yu is obtained as follows with equation (39): 


\V~V o|< "T + z i[Q _l z 


1/2 




— ( ~ T ^ 1 1 T ^/>|2 J *1 + ^Pw\ x ‘i + Pt> x \ + ^Pz\ x \ x l + P:\ :i x 2 ) ^ ) ( 1 HT ) 

rr 


1/2 


Confidence and prediction intervals for inferred inputs are obtained as follows: let 1 x 2 
vector by = [by \ b ?/v] denote the simultaneous two-dimensional calibration confidence interval 
or prediction interval defined in equations ( 183) and ( 184) that corresponds to observed output 
vector y () . Let 6x denote the uncertainty (calibration confidence interval or prediction interval) 
of inferred input vector x n corresponding to observed output y () . 'Then <^x is given by 


bXi) = ^ynC,.' 


(185) 


where 


C 


12 


?11 C l v> 

?21 C22 


(186) 


14, Concluding Remarks 

A generalized statistical treatment of uncertainty analysis for instrument calibration and 
application has been developed. Techniques for propagation of measurement uncertainties 
through experimental data reduction equations and for presentation of final engineering test 
data results, which are well-established in the literature, have not been presented. Instead, the 
emphasis has been on rigorous development of the correct statistical treatment of correlated 
measurement uncertainties, correlated calibration standard uncertainties, nonlinear mathemati- 
cal instrument models, and replicated calibrations, for which only heuristic approaches had been 
available. Correlated bias errors may produce significant magnification of the uncertainties of 
the calibration standard. 

The effects of mathematical modeling error upon bias uncertainties have been quantified. A 
design figure of merit has been established to assess the effects of experimental design on bot h 
precision and bias uncertainties during calibration. Generally, predicted output variance due to 
precision errors is minimized by calibrating only at zero and full-scale loads, whereas predicted 
output variance due to modeling error is minimized by uniformly spacing test points throughout 
the operating envelope of the instrument. 
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Calibration confidence intervals and prediction intervals of anew measurement, for both the 
predicted output and the inferred input, are obtained as functions of the applied load. Previously, 
instrument uncertainties were typically specified as constant error bands or as a fixed percentage 
of the full-scale input. 

Replicated calibration is necessary to obtain adequate statistical sampling, to test for 
nonstat ionarity. and to test for significant bias uncertainty. Analyses of variance of t he regression 
residual sum of squares have been applied to obtain individual estimated values of the standard 
error due to bias uncertainty and the standard error due to precision uncertainty. 

Additional associated uncertainty analyses are in progress which apply the results of this 
document to the force sensor modeled by a linear function, the strain-gauge balance modeled 
by a second-degree multivariate polynomial, and the inert ial model attitude sensor in pitch and 
roll modeled by a nonlinear coordinate transformation. The techniques have also been applied 
to calibration of a skin friction balance modeled by a quadratic polynomial. 
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Appendix 

Mathematical Derivations 

Al. Preliminaries 

Al.l. Extended Leant -Squares Analysis. Let t he instrument calibration data input-output, 
relationship be expressed in matrix form as follows: 

y = Ze + e E (187) 

when' Z is Hie I\ x A/ z calibration design matrix, c is the M 7 x 1 parameter vector, y is the 
A* x 1 output observation vector, and e E is the K x 1 random measurement error vector with 
zero mean and A x A covariance' matrix S E . h is assumed that X E can be expressed as 

S E — <Jf\L ( 188) 

where A x K matrix U is symmetric and positive definite and measurement variance erf is to 
be determined. Then U can be decomposed into the matrix product 

U = PP T (189) 

where A x A matrix P is a nonsingular lower triangular matrix (ref. 12). For notational 
convenience let P“ T = [P '] . 

A 1.2. Lemmas and Theorems. 

The following simple propositions, used frequently in the development, are proven for later 
use. A matrix is said to be diagonalizable if it is similar to a diagonal matrix. 

Lemma 1. U" 1 = P T P 1 

Proof: 

U(p- T p-') - ppTp-Tp-1 

= P(P-'P) T P-' = PP 1 = I K (100) 


where I K is the A* x A identity matrix. 
QED 


Lemma 2. Matrix A is idempot.ent if and only if it is diagonalizable and its eigenvalues are 
either 0 or 1 . 

Proof of Sufficiency : By hypothesis A 2 =A. It is well-known from linear algebra (ref. 12) that 
the eigenvalues of A must satisfy the scalar equation A* 2 = A, from which it follows that A = 0 
or A = 1. In reference 11, A is shown to be diagonalizable. 


QED Sufficiency 
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Proof of Necessity: By hypothesis the eigenvalues of A are either 0 or 1 . Since A is diagonalizable 
a nonsingular mat rix F exists such that A = T I A F~ ! and I A is a diagonal matrix of zeros and 
ones. It is clear that I A I A — I A . Therefore, AA = A. 


QEI) Necessity 


Lemma 3. If matrices A and B have dimension N x M and M x N, respectively, then 

tr(AB) = tr (BA). 


Proof: 

V A- \f 

t,r ( ab) = y (ab)„„ = y y 

• n— I n = I 1 

\l V \( 

= y y b m „a nm = y (BA) = tr (BA) (191) 

771= 1 V = ! 771 — I 


QED 


Lenmia 4. If square matrix A is diagonalizable, then tr (A) = t r (A ) . where A is the diagonal 
matrix of eigenvalues of A. 

Proof: By hypothesis there exists nonsingular matrix F such that A= FAT * 1 (ref. 12). By using 
Lemma 3. 


tr(A) = tr (FAT -1 ) = tv(r~ l r\) = tr(A) 


( 192 ) 


QED 


Lemma 5. For N x A' r matrices A and B, tr ( A + B) = tr(A) + tr(B). 
Proof: 


;V V V 

tr( A + B) — ^ ^ ( U}i?i + but ) ) — ^ ^ ^ 7 tn “T* b ini 

ii= 1 n — 1 n= I 

= tr ( A) + tr (B) 


(193) 


QED 


Lemma 6 . If matrix A is idempotent, then rank (A) = t.r(A). 
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Proof: By Lemma 2, A is diagonalizable and its eigenvalues are either 0 or 1 . Then, by Lemma. 4, 
tr(A) = tr (A), where A is the diagonal matrix of eigenvalues. Hence, rank (A) = tr (A). 


QED 


Lemma 7. If I\ x A’ matrix A is idempotent, then I K — A is idem potent with rank K — 
where r \ — rank (A). 

Proof: 


(Ik - A)(I k - A ) = I K - 2 A + AA = I K - A 

By Lemmas 5 and 6, rank (Ik — A) = K — r\. 

QED 


Theorem 1. Let S s \\ — e T We where 1 x A r vector e is normally distributed with covariance 
matrix S f . = <r;'Ix and W is an Nx N symmetric matrix with rank r. Then S s \\ !&\ is chi -square 
distributed with r degrees of freedom and expected value r if and only if W is idempotent. 

Proof of Necessity: Since W is idempotent, by Lemma 2 its eigenvalues an' either 0 or 1. Hence, 
there exists an A x A matrix I such that 


w = r T i w r (194) 

where r T F = I N , and I w is diagonal with r ones and N — r zeros. Note that I w — I\\Tw Let 
<7w — IwEe. Then 


CwCw = er T I w l€ = e T W e = Ssn ( 1 95) 

Moreover, 

s,- w = € [<wC£] =i w rs E r T i w 

= or^I w rr T I w = rr£l w (196) 

Therefore, Cw /&e is normally distributed with covariance matrix Iw- Thus, Ssw/ffjr equals the 
sum of squares of r independent unit variance normal variates, and therefore Ssw/^f is <dii- 
square distributed with r degrees of freedom (ref. 7). The expected value of S'sw is obtained by 
using Lemma li and equations (195) and ( 196) to yield 

t [Avir] — £ [tr (CwCw)] ~ [D(CwCw)] 

= tr(S Cw ) =<r ,J tr(I w )=^r (197) 


QED Necessity 



Proof of Sufficiency: By hypothesis Ssw/cTf is chi-square distributed with r degrees of freedom 
and, hence, equals the sum of squares of r independent zero- mean, unit-variance normal variates. 
Symmetric matrix W can be written as 


w = r T A w r (198) 

when' N x A 7 diagonal matrix A w contains r nonzero elements since W lias rank r. Define 
Cw = A^‘Pe, where the elements of diagonal matrix A^ equal the square roots of the 
corresponding elements of A w . Note that £ w contains r nonzero elements. Then 


Cw Cw — 


c T r T A w rc = € t w € = s S \v 


(199) 


But 


'Cw 


= - [CwC 


- A 'A 1 


\^rs R r T A^ = it* A^rr T A^ =*l\ 


'Ai 


1/2 


W 


( 200 ) 


If any nonzero element of A w does not equal 1, the hypothesis that Ssw/^f t^ju&ls the sum of 
squares of r independent unit- variance normal variates is contradicted. Hence, diagonal matrix 
Aw contains only ones and zeros, and by Lemma 2, W is idempotent. 


QE D Sufficiency 


Theorem 2 (ref. 19). Let e T e = E q m . for 1 < m < M, where 1 x N random vector e is normally 
distributed with covariance matrix I N . </ m = e T Q m e, and nonnegative indefinite N x N matrix 
Q„, is symmetric with rank Then the variables q m are independent chi-square distributed 
random variables if and only if ^ • f° r 1 < w < A/. 

Proof of Necessity: By Theorem 1, e T e is chi-square dist ributed. Also, by hypothesis 

= yVQ,„ c = Y i q„, (2oi) 

m= I rw — 1 

where Q m has rank r w and 


w 


Y r,„ = A’ (202) 

m = I 


Since Q m is symmetric and nonnegative indefinite with rank r„ t , it can be expressed in the form 


Q>» = PlA m P„, (203) 

where P,„ is orthonormal and A,„ is diagonal, containing 7*,„ positive elements and ( N - r „, ) 
zero elements on the diagonal. After rearranging its elements, matrix Q,„ can be written in 
partitioned form as 
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( 204 ) 


where NxN matrix Pj v — [P^ j P£J. P r ,„ has dimension r w xN , P Sm has dimension ( N —r w )x N , 
and A,. m has dimension v w x r f „. Define r m x N mat rix It rm as 


R,,„ = A^ 2 P r „, 


It is seen that R T( has rank r w and that R^ P Vm = Q m . Also define r w x 1 vector £ w as 


£,„ -R,„x (20(5) 

where x is a .11 arbitrary N x 1 normally distributed random vector with covariance matrix I N . 
Then, inner product q m = Cj,A w — x T Q w x forms N x N matrix R, 7 from the set of M mat rice's 
R, as 

R. 

R, = j (207) 

x«. 

It follows from equation (202) that R„ has rank N and is therefore nonsingular. ( -oust rue t N x 1 
vector £ from subvectors £, defined in equation (206) as 


” £1 

£ = ; = Rx 

-£w- 

It follows that 


(208) 


x T x = x T Q,„ x = = X T R^R,.X (209) 

m= | /?;— j 

Since equation (209) holds for arbitrary vector x, it follows that R^R, = In = R,Rj and, 
hence, R, is orthonormal. The covariance matrix of £ is found to be 

s € = £ [tf T ] = R,. € [xx T ] Rj = R..R.J = I N (210) 

Therefore, the covariance matrix of equals I m . It then follows from Theorem 1 that random 
variable q m = CU is chi-square distributed with r w degrees of freedom. Moreover, since R,. is 
ort honormal, the set of random variables q m is mutually independent. 

QED Necessity 
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Proof of Sufficiency: Construct, matrix R ? and vector £ as before. By hypot hesis, the elements £„, 
are mutually independent with chi-square distributed inner products; thus, covariance matrix 
contains r = m ones on the diagonal and zeros elsewhere. Since x T x is chi-square distributed 
with N degrees of freedom, it follows from equation (209) that £ T £ is likewise distributed. Hence, 
rank equals ;V and A ,r = r. 


QKD Sufficiency 

A 1.3. Linear Leant- Squares Estimation. 

Fiom equation (187), note that the expected value of y is given by 


C[y] = Zc (211) 

Define A* x 1 transformed observation vector v as 

v = Py (212) 


Va\ nation ( 187) now becomes 


V = P'Zc + P'ce = P Z< +e v 


(213) 


where I\ x 1 vector e v = P 1 €r. Immediately the expected value of v is 


/x v = £[v] = P 1 Zc 


(214) 


Then the A x A covariance matrix of v (which equals the covariance matrix of e v as well), 
denoted by X V1 is obtained with the help of equations ( 188) and (189) as 


Sv = £[{v - Mv)(v - Mv ) T ] = P“‘^[€e4]P' T 
= p-'S E P T = (t[P-'PP t P t = (T)\ K 


(215) 


Thus the elements of v and of e v are uncorrelated. 

Based on transformed output observation vector v, the desire is to estimate the value of 
parameter vector c, denoted by c, which minimizes the sum of squares Ssq given by the following 
inner product: 


S, Q = (v - AH ) T (v - Mv) = (v - P-'Zc) T (v - P-'Zc) (216) 

Note that equation (216) may be rewritten as 


Ssq = (y - Zc) T p- T p-'(y - Zc) = (y - Zc) T U-'(y - Zc) (217) 
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It is well-known (ref. 7) that the least-squares value c which minimizes equation (21(5) is obtained 
as follows: 

£= [(p- | z) T (p- | z)]- | (p-'z) T v = (z T p- T p-'zr'z T p- T v 
= (Z T U' l Z)-'Z T p- T v = (r'Z T P T v (218) 

where M, X M 7j generalized moment matrix Q of the experimental design is defined as 

q=Z T U“'z (219) 

It is to he noted that. Q T = Q. With the help of equations (213), (2M), and (218) the expected 
value of c is found to be an unbiased estimate of c as follows: 

£[c] =Q- | Z T P- T £[v] = q-'Z T U 'Zc 

= Q -l Qc = c (220) 

T he covariance matrix of c is found by first combining equations (213) and (218) to obtain 

c-c = Q 'Z T P T (P-'Zc +e v ) - c = Q-'Z t U-'Zc + Q 'Z T P T e v - c 

= Q 'Qc + Q 'Z T P T c v -c = q z T P T e v (221) 

It is seen that c — c is normally dist ributed since e v is normally distributed. From equations (219) 
and (221) it follows that A/ z x A/ z covariance matrix £7 is given by 

= e [(c - c)(c - c) T ] = Q - 1 Z T P- T £[e v e?j = P ZQ 1 
= 4Q- | Z t U- | ZQ-' = 4Q QQ ' = (222) 

Define A x 1 predicted output vector v by 

v = P -1 Ze (223) 

and define A x 1 residual vector e v = v — v. Using equations (213), (218), and (223) yields 

e v = v — v = v - P-'ZQ-'Z T P T v 

= (I K -P-'ZQ- , Z t P- t )(P-'Zc + € v ) 

= (I k -P , ZQ- , Z t P T )€ V =W K e v (224) 

where A x A matrix W K is defined as 

W K = I K - fl K (225) 

and I\ x K matrix J Ik is defined as 
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(226) 


O k = (P-'Z)Q-'(P- , Z) T 

An integer subscript will be appended as needed to distinguish the dimension of mat rices U, 
W. O Z Q, and I for nonreplicated and replicated experimental designs. 

It is seen that i l K is both symmetric and idempotent as follows: 


Ji K 0 K = [p-'ZQ 1 Z T P T ] [p ZQ-'Z T P T ] 

= P 'ZQ i Z t U 1 ZQ- | Z t P t 

_ p-'zQ 1 QQ-'z T p T = P i ZQ- | Z t P T = Ok (227) 

Also, using Lemmas 3.1, and G, 

rank (O k ) = tr (P'ZQ 1 Z T P T ) = tr (Q 'Z T P T P 1 Z) 

= tr(Q-'Q) = Mx (228) 


Then by Lemma 7. Wk is idempotent with rank A — M, 

It is seen that e v is normally distributed. From equation (224), the expected value of o v is 
zero. The covariance matrix of e v then is found by using equations (215) and (224) as follows: 

S; v = £ [e v ej] = W K £[e v e T v ] W£ 

— ^ a W K W k = fi 7 W K (229) 

The M, x A’ covariance matrix of c and e v is shown to be zero (ref. 7), and with the help of 
equation (215), 

<-ov (c,« v ) = £ [(c - c)6:] = Q-'Z T P- T £ [e v «:] (I K - P 'ZQ 'Z T P T ) 

= a 2 r (Q _i Z t P" t - Q ‘ Z T P T ) = 0 (230) 


Thus c and e v are uncorrelated and independent. 

The residual sum of squares S$fr, defined as the sum of squares of the elements of residual 
vector Ov, is obtained with the help of equation (224) as 


.% r =e^e v = € v *W£W K e v = <W K e v 


( 231 ) 


£[S sf ] = <r- F ( K - A/,) (232) 

From equation (228) and Theorem 1, is chi-square distributed with K — M z degrees of 

freedom and expected value A - M T . 


42 


Therefore S ?r, denoted the standard trivr , is defined as 


= 




sr 


K - AL 


Note that Sf is ail unbiased estimate of er h . 

A confidence ellipsoid for e is now obtained. Evaluate the quadratic form 

*sc = (C - c) T Q(c - c) 


with equation (221) to yield 


Sst = (c.-c) Q(C - C) = <P“'ZQ Z ! P“ 'e v = i K e v 


Recall that /\ x K matrix il K was shown by equation (228) to be idempotent, with rank A/ z . 
Then by Theorem 1. it follows that Ssr/(r F is chi-square distributed with Ah degrees of freedom 
and expected value A7 Z . Since c — c and e v are independent, S sr and are' independent. 
Hence, the ratio F = [S S c/(rr} : M 7t )\({S S fJ [^f(K - A/ z )]} is / -distributed with A/ z , A' — A/ z 
degrees of freedom (ref. 0). Therefore, a confidence interval for c at level r> is given by the 
following inequality: 


(<• - «) t Q(c - c) < \I z .%F Uith _ w ,(« ) (235) 

where Fjj(a) is the 1 — o tail of the / -distribution with /, j degrees of freedom and S F is defined 
in equation (233). The quadrat ic form of equation (235) defines an ellipsoid in A/ z dimensional 
hyj>ers]>ace termed the confidence ellipsoid . 

Given A 1 7 x 1 input vector z. the corresponding predicted scalar output y is given by 


y( z) = z T c (230) 

From equation (220), the expected value of y(z) equals z T c. With equations (222) and (230), 
the variance of y(z) is obtained as follows: 

a^(z) = £({y( z) - £[y{z)]} 2 ) = £{[z T (c - c)] 2 } 

= £[z T (c - c)(c — c) T z] — z T £ [(c — c)(c — c) T ]z 
= z T S 0 z = a 2 F z t Q _1 z (237) 


Then the normally distributed variate 6y( z)/ [fr / r(z T Q _, z) 1//2 ] has zero mean and unit variance, 
where /ty = y—y. Recall that is chi-square distributed with 1\ — A/ z degrees of freedom. 

Then the ratio / defined as follows has Student s /-distribution wit h K — Al 7 degrees of freedom 
(ref. 7): 


W*)/ K(z t Q-'z)' /2 ] 

Ssf/ P f( h ~ V z ) l,/i ] 


( 238 ) 
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Combine equations (233), (237), and (238) to obtain the calibration output confidence interval 
defined by the following inequality: 

\y-y \ < (z T Q-'z) 1A '.SV/ A _ ;Uz (n/2) (239) 

when' /„(a) is the o-percentile of the two-tailed /-distribution with n degrees of freedom. 

A2. Effects of Process Modeling Error 

Consider a process /( c,z) modeled as a linear function of extended input vector z 


f(c.z) = ZC 


(240) 


whereas the actual functional relationship is 


/(c. z) = zc + 7 (z) (211 ) 

where 7 (z) is the modeling error. Let the system be calibrated with calibration design Z in 
accordance with equation (187) based on the linear model in equation (240). The observed 
cal il) ration output is then 


y = Zc + 7 (Z) + e E . 

where 7 (Z) denotes the K x 1 vector of modeling errors 


f 7( z i ) 1 


7(z) = 


( 212 ) 


(243) 


L 7( z a ) J 


Estimated coefficient vector c is obtained from equations (218) and (242) as follows: 

£ = Q- | Z T U -I y = Q-'Z t U _i [Zc + 7 (Z) + e E ] 

= c + Q- | Z t U- , [ 7 (Z) + £ B ] (244) 


The expected value of c is seen to be 


£[£] = c + q-'z t u-' 7 (Z) 


Predicted output vector y becomes 


(245) 


y = Z6 = Zc+Z(r 1 Z T U-'[ 7 (Z) + e E ] 


(24(5) 
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It follows from equat ion (246) that the expected value of predicted output, vector y is given by 


€[ y] = Zc + ZQ-'Z t U- | 7 (Z) 


Combine equations ( 242) and (240) with (225) to obtain residual vector c v as 


(247) 


e v = v -v = p-'(y-y) = P- 1 (I K - ZQ- | Z T P- T P-') fr(Z) + e P J 

= (I K - P-'ZQ- | Z T P- T )[P- , 7 (Z) + c v ] =W K [P-S(Z) + e v ] (248) 

The expected value of is seen to be 

£|5v] = W k P-' 7 (Z) (249) 

After combining equations (215), (248), and (249), the covariance matrix of e v is found to be 

= ?{[o v - £(S v )][e v - flcun = -; W K (250) 

**v 

Since W K is idempotent, the residual sum of squares is obt ained from equation (218) as follows: 

Ssf = ej6 v = [P-S(Z) + e v ] T W K [p-' 7 (Z) + cv] (251) 

Because W K has rank I\ — A/ z . the expected value of $ S r- is 

£[S S f]=( K - A/,)4 + 7(Z) T P- T W K p- 1 7 (Z) (252) 

Note that $ F = [S SF /(I\ — A7 Z )] I/2 is no longer ail unbiased estimate of a when modeling error 
7 (z) is nonzero. 

Consider arbitrary input vector z. The corresponding output y, obtained with equation (241), 
is 

y - /( c,z) - zc + 7 (z) (255) 

The predicted output is y = zc. Prediction error by Is then 

h f = y-y= T(») - ZQ-'Z T U-'[ 7 (Z) + c E ] (254) 

The expected mean-square prediction error is obtained from equat ion (254) as 

al(z) = £[(> y 2 ] = [ 7 (z) - zQ- , Z t IT 1 7 (Z)] 2 + 4z T Q-'z (255) 
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A3. Nonlinear Leas t-S qua res Estimation With Input Uncertainty 

Let, c denote the M r x 1 parameter vector; (z + ^z), the 1 x M 7 stochastic input vector, where 
z is the I x M 7 nominal input vector and Sz is the 1 x M 7 stochastic input uncertainty vector; 

the measurement uncertainty, a. zero-mean random variable. Then the process output, is of 
t he form 


V = /(<‘.z + bz) + ey = f{ c, z) + by 
The uncertainty b ty of the jbtli observation is then 


(256) 


by l - bf ; +(,, t 

where 

bfu = f z (e,z ( )Az ; 

and the 1 x M, vector f z (c.z *) is defined as 


t(c.ej = 


rt/(c,z<) 


c) z 


Define /\ x 1 error vector as 


bi 7 . = [^/: i . . . */:a] t 


It is seen that bi z is given by 


bf z = 


f.,(c,z x )bzj 
f z (c,z A )bzl 


(257) 


(258) 


(259) 


( 260 ) 


(261) 


Note that subscript z is appended to indicate that bf depends on the entire design matrix Z. 
The J\ x I\ covariance matrix of bf 7 is given by 

£f, = mtfj) (262) 

Tlie K x 1 out put vector y is obt ained by extending scalar equation (256) to the following K x 1 
vector equat ion 


y = f(c,Z) + by (263) 

where Z is the K x M, design matrix . and by is the K x 1 zero-mean combined output uncertainty 
vector given by 
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I, 



<Sy _ Sf 7 + 6 F/ 


(264) 


and Sy ha.s A x K combined output covariance matrix X Y which can be expressed as 

Sy = Sr, + S E (265) 

The assumption is that S Y can be expressed in t he form of equat ion (188), namely S Y — 
w lie re U satisfies the conditions of equation (189), with transformed K x 1 output vector v 
defined in equation (215). and equation (265) becomes 

v = p- 1 f(c,Z) + /5v (266) 

where A x 1 uncertainty vector Sv = P _l ^y and I\ x I\ matrix P is defined as in equation ( 189). 
The expected value of 6v is zero, and the expected value of v is 

# i v = f[v] = P“ , f(c 1 Z) . (267) 

The f\ x }\ covariance matrix of Sx, denoted by E V1 then becomes 

S v = £[(5v$v T ] = p-' £[< > iyfy T ]P“ T = 4p-'UP' T = <r*I K (268) 

It is seen that Sx is uncorrelated and normally distributed whenever Sy is normally 
distributed. As in equation (216) define the sum of squares as 

S SQ = (v - ft v ) T (v - Mv) = [v - P“'f(c.Z)] T [v - P“'f(c,Z)] (269) 

To minimize S S q (ref. 15) compute its gradient with respect to c and equate the resultant 1 x M r 
set of equations to zero as follows: 

h "K^) =iv - p " f(cz)iTp dS ,c ' z) 

= [v - p-'f(c,Z)] T p-'F r = 0 (270) 

where h is a function of independent arguments v, c, and Z and lias dimension 1 x M 
[v — P 'f(c, Z)] is A x 1. P is A x A’, and K x A/,, matrix F,. is defined as 


’ di 

F r = — (c.Z) 

dc. 

"h ) < } fh < r ' 7 A ) 

f**l ( }r M r 
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Finally 0 denotes a 1 x M c vector of zeros. Equation (270) is solved numerically for c by Newton- 
Raphson iteration or similar method. Necessary conditions for the existence of a solution are 
now obtained. 

To obtain the uncertainty ofc denoted by Sc, compute the total differential of equation (270) 
and equate to zero as follows: 


(T — *v T 


dh 

dx 


+ *6 t R = 0 


where A x AY r matrix [f)li/c)v] is seen to equal 


dh 

dx 


P 'F, 


and the M c x M r matrix R is defined as 


dh 

dc 


()cj 


ih'\ 




Or\ i)e m 


i>r ly 


(272) 


(273) 


(274) 


A necessary condition for the existence of a solution to equation (270) for c and to equation (272) 
for Sc is that matrix R be nonsingular in some open interval about c (ref. 11 ). 

To evaluate R differentiate equation (270) with respect to c as indicated to obtain 


R, = FjP~ T P _1 F r + [v - P ^(c, Z)] T P' ] C F ir = FjU“'F r + H E (275) 


where He is defined as 


He = [v - p- 1 f(c.Z)] T p- 1 0 Fee (276) 

The Al r x A/ r x A array F rr is defined as the partial derivative of M r x K array Fj with respect 
to vector c; that is, 


F = 

r e. — 


dF?(c,Z) 


(277) 


where the ijk t.h element of F r r(c, Z) equals the second partial derivative of the kth element of 
fiuiction f(c,Z) with respect to c, and cj as follows: 


Tc.c.. ijk 


d' 2 h( c,z t ) 
dc, dcj 


(278) 
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for 1 < i,j < Af r , and 1 < k < K. The ® operator denotes formation of the inner product of 
1 x K row vector [v — P~ l f(c,Z)] T P“ l with eacli K x 1 column of array F rr . Thus the ijth 
element of M c x M c mat rix H E is given by 


h FJJ = [v - p-'f(c, Z)] T P-'F„,, 7 = eJP l F crij (279) 

for 1 < i.j < iW r , where F cci} denotes the ijth (K x 1) column of array F rr , and 

e v = v — P _1 f(c,Z). After le&st-squaresestiination of vector e, vector e v becomes residual vector 
e v defined subsequently. If norm || e v || is small, matrix H R can be neglected in equation (275). 
Then R is closely approximated by 


R« FjU-'Fc (280) 

Note that matrix R has rank A/ r , i.e., is nonsingular, only if rank(F c ) = M r . Combine 

equations (272) and (275) and solve for M c x 1 uncertainty vector Sc to yield 

(Sc = — R _1 FJP _t ^v (281) 

From equation (281), Sc has zero mean and covariance matrix as follows: 

£, = R" 1 Fj P " t E v P~ 1 F c R‘ 1 

= (TyR - 1 F J U“ 1 F r R“ 1 = aj Q7 1 (282) 

when' M c x M c matrix Q r equals 

Q r = [R-'F^U-'F.R- 1 ] -1 (283) 

Note that satisfaction of the approximation in equation (280) is a sufficient condition, but not 
necessary, for the existence of mat rix Q r . Equation (280) implies that 


Q r % R 


(284) 


A 3.1. Residual Sum of Squares. 

As for calibrat ion design matrix Z and estimated parameter vector c, define K x 1 predicted 
output vector v as 


V = P 'f(c, Z) = P 1 [f(c,Z) + F e *c] 

= P 1 [f(£, Z) -FrR-'Fjp-^v] =p-'f(c,Z)-(Mv (285) 


where 


12 F = (p-'F r ) R-' (P-'F,.) T 


(286) 


/Vs before. K x 1 residual vector e v is defined as 


49 



e v = v — v = P“'[f(c, Z) -f(c, Z)] + 6v 


(287) 


Let ^f r = f(c,Z) — f(c, Z), which is closely approximated by />f r = F r (c, Z)£c. Then 
equation (287) can he expressed in differential form as 


e v = P 1 F r (c, Z)6c + ^>v (288) 

Combi ne equations (281), (286), and (288) to obtain 

e, = (I K - P F r R F^P T ) &v = W Fh Sv (289) 

where 

W Fk = Ik-«f (290) 

Subscript A’. appended to denote the matrix dimension, is treated as an index. If approximation 
in equation (280) holds, t hen is idempot.ent. as is shown in the following equation: 

il F il F = P-'F,R-'FJP T P 'F r R 'FjP“ T 
= P _1 F,.R~' (FjU“'F r ) R FjP T 

= P-'F.R 'F^P T = il F (291) 

By using Lemmas 2, .‘b and 6, 

rank ((lp) = tr (p-‘F r R- , FjP“ T ) = tr (R 'FjP T P *F r ) 

= tr (R _l FjU _l F c ) = tr(R-'R) = A/ r (292) 


Therefore, by Lemma 7, W F(> is idempotent with rank A — Al c . 
The covariance matrix ofe v is given by 


£ e =<7 *W Fa (293) 

and the residual sum of squares S$jr is given by 

Ssf — Sje v = 6v T W Ff . 6v (294) 

Then by Theorem 1, S SF: is chi-square distributed with A — M c degrees of freedom and with 
expected value 


S(S SF ) = (K- M, )(Ty 

An unbiased estimate of <xy is provided by st andard error S\ , where 


( 295 ) 
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Sy = 


s< 


SF 


1/2 


A" - M v 

A confidence interval for a y at confidence level a is given by 


(296) 


(K - M r )'*Sy ^ ^ (K -M r )^Sy 

< Gy < 


(297) 


■\( l + o )/2 \(\-«)/'2 

where \, t is the o percentile value of the chi-square distribution with I\ — M c degrees of freedom. 

A3. 2. Confidence Interval 
A confidence ellipsoid is now obtained for r. Let 


S S r = (c - c) l Q c (c - (?) = <*>v P F r R Q r R F‘ P“ V>v 
= <W T P F.R-'FTP^v = 6v T ft F l5v 


Because Hf is idempotent, Ssc/Fy is chi-square distributed with A/,- degrees of freedom by 
Theorem 1. Hence, the ratio F = [.S'sy ■ / <?). A/,.] / { ,S' S ' ;./ [<r'f •( h — A/,.)]} is F-distributed with 
A/,.. I\ A/,, degrees of freedom (ref. 7). Then the confidence ellipsoid at level a for c is defined 
bv 


(c — c) T Q r (c — c) < M r Sy Fu,. h - m,.( o) 

For arbitrary input vector z, the corresponding predicted scalar output denoted by y( z) is 


,v(z) = /( c. z) 


(300) 


The uncertainty of y{ z) due to calibration uncertainty alone is obtained with equat ion (281) as 

f>y = y-y = /(c, z) - /(c,z) 

\df(c,z)} 


dc 


6c = — f r ‘ (c, z)R, F,! P V>v 


(301) 


where M r x 1 gradient vector f, ( c . z ) is defined as 


fr(C, Z) = 


dfi c,z) 


dc 


(302) 


It follows that 6y is normally dist ributed with zero expected value. Then the expected value of 
y( z) is 


£[y{ z)] = /( c,z) 


(303) 
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The variance of predicted output t/(z), denoted the variance function, Ls obtained from equa- 
tion (301) as follows: 


<t\( z) = f[6y 6y] = f r T (c,z)R _ ^v T ]p- T F r Rr'f r (c, z) 

= 4f r T (c , z ) R ' FjU ‘ ' F, Rr 1 f r (c, z ) 

= 4f r T (c,z)Q-'f r (c.z) (304) 


If the approximation in equation (280) holds, then equation (304) simplifies to 


4( Z ) - 4 C ( <- ■ Z )R f r ( c, z ) 


(305) 


l'lie normally distributed variate by(z)j 

variance. It was shown previously that Ssr/v'y is chi-square distributed with I\ - M,. degrees 
of free 1 do m when the approximation in equation (280) holds. Then the ratio / defined below has 
Student ’s /-distribution with A — ,V/,. degrees of freedom. 


C( c ' z )Q 


-i 


f r (c,z) 


1 


has zero- mo an and unit 


fiy(z)/ joy [f7(c, z)Q € ‘f r (c,z)] ^ | 
s:,,/[a v (A'-M r )'4 


Then the out put prediction confidence interval at a confidence level Ls given by 


(300) 


I.V - 51 < [fjle. z JQ,-. 1 f,(c, z)] l/ ' J ,SV//,-_.u,(o/2) (307) 

where /„(«) Ls t he a ]>ercentile value of the two-tailed /-distribution with n degrees of freedom. 

A4. Analysis of Replicated Calibrations 

In the following development, subscripts K and NK are appended to matrices I, Z, Q, U. 
and Si to distinguish between single calibrations (A observations) and replicated calibrations 
(NK observations). Consider an arbitrary A' x M z experimental design matrix Z K for calibration 
of a single- out put sensor, which is replicated N times. The sets of input loading uncertainties 
are seen to be in ter cor related among replications. The NK x A-/„ replicated experimental design 
ZfMK IS 


Znk — 


Z K 

Zk 


= h t z k 


(308) 


where A x NK replication matrix H is defined as 


H = [Ir Ik Ik] 


(309) 
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The following properties of H are used in the subsequent development. The I\ x I\ matrix 
product HH T equals 


HH T = AT k 

and NK x N K matrix product H T H equals 


(310) 


Ik 

Ik 

Ik 

Ik 

Ik 

Ik 

Ir 

Ik 

Ik 


(311) 


For any I\ x I\ matrix A. the N A x N K matrix product H T AH equals 


H T AH 


A A A 

A A ... A 

A A ... A 


(312) 


Let D N k be an N K x A /\ block diagonal matrix constructed from I\ x I\ matrix A as 


Dnk 


A 

Ok ■ 

Or 

Ok 

A . 

0 k 


Or 0 k ... A 


where Or is a A x A matrix of zeros. Then it follows that 

HD nk H t = A' A 


(313) 


(314) 


A4‘l* Single-Input Single- Output Process With Un corid at ed UnceHainties. 

Over N replicated calibrations, let t he elements of A' A x 1 measurement uncertainty vector e E 
be uncorrelated with N I\X N K covariance matrix o'"^I NKl and let the unknown bias uncertainties 
of a single replication due to the calibration standard be uncorrelated with covariance matrix 
<t;.I k . Since the loading sequence is replicated, then 


cov 


~/r 


— cr; 


= 0 


( \k — /| = n K ; 7? . = 1 , ... , A r — 1 ; m — 1 , . . . , M 7 ) 

(Otherwise) 


(315) 


where Zk m is the mth element of vector Zk and k — 1,. . NK. Thus, from equation (311), the 
NK x NK covariance matrix of design matrix Z is given by 


£z = <t;H t H 


(316) 
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Similarly, the NI\ x N I\ measurement uncertainty covariance matrix is given by 


Xe — a? Ink — G v 


Ik 

Ok • 

.. Ok 

Ok 

Ik 

0 k 

Ok 

Ok 

Ir 


(317 


Noting that aj > 0 and <r; > 0, define combined output covariance matrix S Y as 


S Y = S E + S z = rjr Ink + <t;H t H = 


NK 


(318) 


whe 


re 


and 


Unk — Ink H - oH t H — 


It is readily shown that 


U*' K = I NK - /?H T H 


(« + 1 )Ik 

oIk 

oI K 

oIk 

( o + 1 )I K • 

oI K 

oI k 

aI K 

• • + 1 )Ik 

»=£ 




-/« K • 

-01k 

—01k 

(I-^)Ik • 

—fti-K 

“$Ik 

~0l K 

■ (1-/?)I K 


(319) 


(••520) 


(321) 


/here 


,^=T7 


A (\ d- 1 


Then M 7 x A/ z generalized moment matrix Q NK is obtained with the help of equation (310) as 
follows: 


Qnk = Z£ k U n ' k Znk = Z^H(I nk - 0H T H)H T Z K 

= N(l-Nl3)ZZZ K 
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Combine equations (320), (322), and (323) to yield 


Qnk — 


<T\ 


(af/N) + a 


,X-Z K 


(324) 


Note from equation (324) that the portion of calibration uncertainty due to calibrat ion standard 
bias errors is not reduced by replication, whereas that due to measurement, errors decreases 
roughly as 

For the analysis of variance tests presented subsequently in the null hypothesis the input 
uncert ainty is assumed to be zero. Then <r r = (} and matrix U NK equals I NK ; consequently, P 
equals I^k in equation (189). For this special case, equations (308), (310), and (323) imply that 


Qnk = Z; k Z nk = Z£HH t Z k = A'Z£z K = A Q K (325) 

From equations (226) and (325). N I\ x N A matrix 12 N k is given by 

»NK = Z nk QSkZSk = i-H T « K H (326) 

A 

w lie re A x A matrix J2 k is 

Ok = ZkQk Z£ (327) 

As shown in equations (226) and (228), tl# and 12 >*k are symmetric and idempotent with 
rank My. 

A4-2 . General Multi' Input — Single- Output Process . 

Consider a general mult i-input-single-out put nonlinear process calibrated by using experi- 
mental design Z K replicated N times as before. The A x 1 output uncertainty vector of a single 
replication, denoted by ^yK, is given by equation (264). Then for N replications N A’x 1 output 
uncertainty vector <*>y N K is given by 


^Ynk — H T <5f z + €e (328) 

where K x 1 vector is given by equation (261) with I\ x A covariance matrix = cq 2 U fZK , 
given in equation (262). and where N K x 1 measurement uncertainty vector €e has N K x N A 
covariance matrix E e = <j\ U Enk - The measurement uncertainty is assumed un correlated 
between replications and the A x A measurement covariance matrix of each replication is 
assumed to be E Ek = e k * Then 


Ue k Ok • • 0 K 
Or U Ek 0 k 

Ok 0 k Ue k 


( 329 ) 


and from equation (328), 




where n is defined in equation (320). 

The inverse of A7v x NK matrix U Ynk can he computed in terms of A x A matrices 
and U F as follows. Define A x A matrix B as 

L K 

B = [U Ek + (A' - 1 )«U Ek ]-'U Ek (333) 

and A x A matrix A as 


A = { U Ek + oU % [I K - (N - 1)B]} (334) 

If the inverse matrices of equations (333) and (334) exist, then U k can be shown to be given 
by 

A -BA . .. -BA 
-BA A ... -BA 

Uy^ = Dnk — H t BAH = . . 

-BA -BA A 

where NK x N I\ block-diagonal matrix D NK is constructed from A' replications of K x I\ matrix 
(A + BA) as 

'A + BA 0 k ... 0 K 
0 K A + BA ... 0 K 

Dnk = 

Ok Ok ... A + BA 

For the linear case M r x M, moment matrix Q N k can now be computed in terms of K x A 
matrices as follows: 
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q NK = ZSkU^Znk = (Z£H)U v ^ k (Z£H) t 


(337) 


It can readily be seen from equations (314), (335), ami (336) that 

HU y ^ k H t = H(Dnk - H t BAH)H t = N[Ik - ( A - 1)B]A (338) 

Hence for the linear case, 

q NK = AZ£[I K - ( A’ - 1 )B]AZ k (339) 

For the nonlinear case, a single' replication of experimental design Z K , evaluation of equa- 
tion (271) yields I\ x M c matrix F Ck . Then over N replications of Z K , with design matrix 
Zjvk given by equation (308), equation (271) yields N I\ x AI r matrix F rNK = H T F rK . If equa- 
tion (275) holds, it follows from equation (338) that 


R 


u; 


F = F 1 

<Mk A r 


HUy 1 H T F rk 

Y NK r K 


AF c t k [I k -(A - l)B]AF,. K 


(340) 


Equation (340) permits computation of confidence and prediction intervals for replicated cali- 
bration data in terms of K x I\ matrices; thereby, required computer storage and computational 
resources are reduced when A is large. 

With reference to equations (188) and (189), the analysis of variance null hypothesis assumes 
that if matrix U Ynk = Ink^ then matrix P = Ink- If equation (280) holds, then for the null 
hypothesis M c x M c matrix R. becomes 


R 


F 1 F 

r NK 

= nK F,. k 


= F 


HH'F ri 

K r K 


(341) 


It. follows that N !\ x Nh matrix S J F . given in equation (28(5), is given by 


lit- = F^,R-'Fj = — H T F r (Fj F CK )-'Fj H 

r NK °NK ^NK ,\r r K' r K r K ’ 

1 T 

= y h °f k H 


(342) 


where K x K matrix II FK is obtained from equation (286) as 


n, K =F BK (Fj lt F eK r , F: if 


(343) 


As shown in equation (291), matrices H Fk and F&f nk are symmetric and ideinpotent with 
rank Mr. 
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A4-3- Analysis of Variance of Replicated Calibration «s\ 

Analysis of variance of replicated calibrations provides tests of significance for the presence 
of bias uncertainty due to input loading errors or mathematical modeling errors, as well as for 
nonstationarity of estimated parameters. The analysis of variance is developed in this section 
with single-input-single-output process notation. Note that similar results are obtained for the 
general multi-input-single output case by replacing O nk . ft K . W NK , W K , and M, by II Fnk , 
lip K , Wp NK , WF k and M c , respectively. 

Let the null hypothesis (ref. 7) assume that input loading mi certainties and modeling errors 
are zero and that A7\ x 1 measurement uncertainty vector e E has A7\ x A7v covariance matrix 
S F = (T)Im K . Then A7v x A7\ matrices U and P are both equal to I N r- and do not appear 
in the following equations. Transformed output vector v is equal to and replaced by observed 
output vector y. 

The A' x I\ mat rix W K is defined in equation (225) as 


W k = I k -«k (344) 

Matrix W th is defined similarly in equation (290). After A r replications A’ x A matrix W K 
expands to A7v x A7\ matrix W NK given as 

W nk =I nk -«nk (345) 

where matrices iiivK aiul 1If nk are in equations (526) ami (342) and has rank A/*. Since SInk 
Ls idempotent , then by Lemma 7 matrix W NK is idem potent, with rank A' A' — M r . 

For use in the development, define AA x A7v matrix Gh as 


G h 


1 T 1 

— h t h = — 

N A 


Ik Ik 
Ik Ik 



(346) 


It is readily seen that G H is idempotent with rank K. By Lemma 7. matrix I NK - G H is 
idempotent with rank A7v — A. 

Next G h is shown to be a two-sided identity of any matrix of the form l/A r H T AH, in 
particular S i \ k Indeed, from equations (326) and (342), 


GhIInk 


— H t HH t SI,,H = — H T « k H = O nk 

A'- K A r K 

— H t S1 k HH t H = « nk g h 

N' 2 


(347) 


From equations (345) and (347), 

G||W nk = W nkGh 


(348) 
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Therefore, NI\ x NK matrix product W nk G h W N k, to be used later, is idempotent. Also, it is 
seen that 


WnrGhWnk — (Ink ~ ^ nk )G h (Ink “ Unk ) — (Gth — 12nk)(Ink “ ^nk ) 

— G h — iiivK (349) 

Since G h has rank K and 12 nk has rank M 7 , it follows from Lemmas 5 and (5 and equat ion (349) 
that product WnkGhWnk has rank K — A/ z . Note that K — M z > 0. 

Estimated M 7 x 1 parameter vector e. A/\ x 1 predicted output vector y, and NK x 1 
residual vector b are obtained with equations (218), (223), and (221), respectively, for a linear 
process, and equations (270), (285), and (289), respectively, for a nonlinear process. Recall from 
equation (224) that b can be expressed as 


b= W NK e E (350) 

with zero expected value and NK x NK covariance matrix rWxK • 

Let e n denote the K x 1 residual vector at the 7/th replication, which has zero expected 
value and covariance matrix <7~W K . Then residual vector b can be part it ioned into Ah K x 1 
subvectors as shown below: 


S T = 


r> r rv 1 


mi 


Let e K denote the mean value of the set of residual vectors b n averaged over A : replications; that 
is, 



?/=i 


-i-HS - ^tHWnkce 

A ; /V 


The residual sum of squares, denoted by is defined in equation (231) as 


(352) 


$ sf r = e T e — €eW N k^e 


(353) 


By Theorem 1, S s r is chi-square distributed with N K — M 7 degrees of freedom; the standard 
error of the regression given by 


— 


s k ) 

NK - MJ 


i n 


(354) 


is an unbiased estimate of a. 
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Residual sum of squares S sh can be partitioned into the following sum of quadratic forms: 


Ssh = = o t W nk GJ h W N k^ + ° T (Ink — W NK G H W NK ) e (355) 

By using equations (.348) and (350) and the fact t hat W^k is idempotent. S'sr can be expressed 
a.s 


Ssf = cJWnkGhWivkce + cJWnk (Ink — Gh) Wnkce (356) 

Denote the first right-hand term in equation (355) bv S sx as follows: 

Ssx = o t WnkGhWnko= eEWNKGnWNKtE (357) 

which follows from equation (350) and the fact that W N k * s idempotent. I hen .8 s v can be 
expressed as 


Ssx — c^W NK G H W NK e Fj — A e^e K (358) 

which follows from equations (350), (352), and (357). It lias been shown that W NK G H W NK 
is idempotent wit h I\ — M 7 degrees of freedom. Therefore, it follows from equation (358) and 
Theorem 1 that S s \/^i is chi-square distributed with f\ — A7 Z degrees of freedom. Define the 
root -mean-square value of Ssx as 



Variable S\ is interpreted as the standard error due to bias uncertainty. 

Consider next the second right-hand term of ,S\,- f ;in equation (355). Define S s .u a - s 

Ssm = 52 (t IIjt - e * ) J = 52^“ “ ^ )T ^ ( :i(5() ) 

h=\ V = | 7J = I 

where ?„ L is the kth element of l\ x 1 residual vector e„, and h- is the irth element of A x 1 
vector e k . Variable Ssm is seen to equal the sum of squares about the means of the set of N 
residual vectors e n each of dimension A x 1. It follows from the definition of H that 

v 

Ssm = y^(e lt - eK) T (e„ - 5 k) = (e— H T eK) T (e - H T eK) (361) 

« = i 

Define N J\ x 1 vector e M as follows and use equations (350) and (352) to obtain the result 

e M = o — H T e K = e rrH T He = (Ink ~ Gh )e 

= (Ink — Gh)Wnkce (362) 
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By using equations (360) to (362), 


Ssm = eJjeM = €^Wnk(Ink — GhJWnkce (363) 

Comparison of equations (356) and (363) shows that S s \i equals t he second right-hand term of 
Ssf* Moreover, it is clear that matrix product 


W NK (I NK - G„)W NK — W NK — w nk g h w nk 

is idempotent and, l>v Lemmas 5 and 6. has rank NK — A , since W NK has rank NK — M 7 . and 
WnkG h W nk has rank /\ - A/ z . By Theorem i 1, Ss\i/<r z F is chi-square distributed with NK — K 
degrees of freedom. Variable S s u can be interpreted as the' portion of residual sum of squares 
S s y due to measurement uncertainty. The 1 root -mean-square value 


S 


M ~ 



(364) 


is interpreted as an estimate of the standard deviation a F of the measurement uncertainty. 

It follows from Theorem 2 that Ssx and Ssm are independent. Therefore, the ratio 
T\- w = [3 sx / ( K — \l 7 )]/[$ s\f /( NK — A*)] is /’-distributed with K — A/ z , NK — K degrees of 
freedom. The test of significance for the existence of distinct input loading biases is as follows. 
Assume as the null hypothesis that input loading bias error and modeling error are zero. Form 
the expression 


Ts- 


ai 


Ssx / ( A — A/z) 
S S: \i/(NK - K) 


Xh—I\ ( °) 


(365) 


If inequality (365) is satisfied, then t he null hypothesis that both input loading bias error and 
modeling error equal zero is rejected at confidence level a. 

A4-4* Stationarity Test of Estimated Parameters . 

A test is developed for nonstationarity of estimated individual parameter c m G <* over N 
replicated calibrations. Let cp. H denote the parameter vector estimated at the nth replication by 
a A -point regression, with residual suin-of-squares Ssu u , for n — 1, . . . , N. Define 


A* 



?>=1 


(366) 


Let c denote the parameter vector estimated by an N I\ -point global regression over the complete 
set of N replicated calibrations. To test for stationarity of parameter c w replace the ?»th 
element of c R#( by c m G c and compute resulting the error sum-of-squares, denoted by Ssc mn for 

n — Compute S Si ; w = ^ for n = 1 N. The ratio (Ssc,,,— $sr)/S.sr 

is subsequently shown to be F-distributed and thereby provides a test of significance for 
nonstationarity of the estimated value of c m over the N replicated calibrations. 
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The null hypothesis assumes that calibration standard errors and modeling errors are zero 
and that estimated parameter vector c R „ is stationary over the N replications. Lei. NK x 1 
measurement error vector c E be partitioned among the N replications as [cl ...e Ev ] T . where c E;j 
denotes the K x 1 measurement error vector at the nth replication. Also, let £cr. m denote t ho 
uncertainly of the nth est imated parameter vector, which is obtained from equation (2X1) as 


^R„ 


-r-'f: 


€ E,. 


The uncertaint.y of element € c.r„ is seen to be 


(367) 


= -plF r T e E „ 


(368) 


where {»,(, is the jnth row of R _l . Similarly, the uncertainty of globally estimated parameter 
vector o f; is given by 


*c c = R'F'Hce 


(369) 


and the uncertainty of element c<,„, £ <‘c; 


th;,,, = --I»^F;'Hc e 


(370) 


The residual vector of the nth replication, denoted by e Rii , is found by using equation (288) as 


— F, ^C [; + c Eij (3(1) 

Replace c K by c G , n in equation (371) to obtain the error vector of the nth replication 

computed with the globally estimated value of parameter c,„, which is denoted by From 

equations (368) to (371), the difference between error vectors „ and e Ru is given by 




= f, 


C E,, 


i H£ ') 


(372) 


where f C|H is the tt? t li column of F r . 


Let NI\ x 1 error vector e GR ( 


J GR„ 


... e 


GR U 


of NK x 1 measurement error vector ce as 


T 

, which can then be expressed in terms 


e GR ll( 


Ia 


> t ah) 


CE 


(373) 


where I\ x I\ matrix A =f Cm p^Fj and NK x NK block diagonal matrix I A is defined as 
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Ia = 


(374) 


’A 0 . 0“ 

0 A . 0 

_0 0 ... A. 

It is seen that t he inner product e GR e GR(; equals (Ssa,,, ~ $sr)< Clearly A has rank 1. It follows 
from equation (280) that p^Fjfc,,, = 1. Hence, 


aa = UfXpIfJ - 


t f t 


and A is idempotent. It can then be seen that I A is idempotent with rank N, since A is 
idempotent with rank 1. Thus I A — 1/NH 1 AH is idempotent with rank (;V— 1). and therefore 
the inner product e G R„, can he express d as 


S, 


- Ssn = 


c;r 


, e GR (1( — e i 


1 T 

— h t ah 

N 




(375) 


It follows from Theorem 1 that Ss(,\„ — .8 'sr is chi-square distributed with N — 1 degrees of 
freedom. 

The residual sum of squares of the ??th replicated regression, S SRu = e R W K € E ti • has been 
shown as chi-square distributed with K — A/ z degrees of freedom. Because the error vectors e E/) 
are mutually independent, it follows from equat ion (360) and Theorem 2 that the total replicated 
sum of squares S S r is chi-square distributed with A r (A — A/J degrees of freedom. Therefore, if 
the following inequality is satisfied 


Trm ~ S sr /[N(1< - A/,)] > 

then the null hypothesis that parameter r,„ is stationary is rejected at confidence level a. 


(376) 
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